DOCUHENT RESUME 



ED 338 721 



TM 017 853 



TITLE 



INSTITUTION 

REPORT NO 
PUB DATE 
NOTE 

AVAILABLE FROM 



PUB TYPE 



EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



Raising Standards for American Education. A Report to 
Congress r the Secretary of Education, the National 
Education Goals Panel, and the American People. 
National Council on Education Standards and Testing, 
Washington, DC. 
ISBN-0-16-036097-8 
24 Jan 92 
142p. 

U.S. Government Printing Office, Superintendent of 
Documents, Hail Stop: SSOP, Washington, DC 
20402-9328. 

Legal/Legislative/Regulatory Materials (090) — 
Reports - Evaluative/Peasibility (142) 

MP01/PC06 Plus Postage. 

Academic Achievement; * Academic Standards; Advisory 
Committees; Educational Assessment; Educational 
Change; Educational Improvement; ^Educational 
Objectives; Elementary Secondary Education; 
Feasibility Studies; ^Management Information Systems; 
^National Programs 

National Council on Education Standards Testing; 
^National Information Systems; ^Standard Setting 



ABSTRACT 

Recommendations by the National Council on Education 
Standards and Testing (NCEST) are provided concerning whether 
national standards and a system of assessments are desirable and 
feasible and how national standards and a system of assessments are 
to be developed and implemented. The NCEST found that the absence of 
explicit national standcirds keyed to world-class levels of 
performance severely hampers^ the ability to monitor the nation's 
progress toward the six national education goals. Without 
well-defined and demanding standards, American education has 
gravitated toward "de facto" national minimum expectations, with 
curricula focusing on low-level reading and arithmetic skills and on 
small amounts of factual material in other content areas. Most 
current assessment methods cannot determine if students are acquiring 
the skills/knowledge they need to prosper in the future. These 
assessments reinforce the emphasis on low-level skills and processing 
bits of data rather than on problem solving and critical thinking. It 
is concluded that high national education standards and a voluntary 
linked system of assessments are desirable and feasible mechanisms 
for raising expectations, revitalizing instruction, and rejuvenating 
education reform efforts for all American schools and students. The 
NCEST will work toward local commitment to high national expectation 
for achievement for all students) and toward developing Federal, 
state, and local policies that ensure high quality resources 
(instructional materials and well-prepared teachers). 
Acknow"^ dgments; authorization for the NCEST; public comments; the 
six national education goals; and reports of the standards, 
assessment, implementation, English, mathematics, science, history, 
and geography task forces of the NCEST are appended. (RLC) 
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A LETTER TO 
CONGRESS; THE SECRETARY OF EDUCATIONr 
THE NATIONAL EDUCATION GOALS PANEL; AND THE 
AMERICAN PEOPLE 

As co-chairs of the National Council on 
Education Standards and Testing, it is our 
privilege to present Raising Standards For 
American Education. We believe this report 
is an important contribution in moving the 
Nation toward the adoption of high national 
education standards for ail students and a^ 
voluntary, linked system of assessments. 

Through its deliberations, the Council 
found that the absence of explicit national 
standards keyed to world class levels of 
performance severely hampers our ability to 
monitor the Nation's progress toward the 
National Education Goals. We presently 
evaluate student and system performance 
largely through measures that tell us hew 
many students are above or below average, 
or that compare relative performance among 
schools, districts, or states. Most 
measurements cannot tell us whether 
students are actually acquiring the skills 
and knowledge they will need to prosper in 
the future. They cannot tell us how good is 
''good enough" • 

In the absence of well-defined and 
demanding standards, education in the 
United States has gravitated toward de 
facto national minimum expectations, with 
curricula focusing on low-level reading and 
arithmetic skills and on small amounts of 
factual material in other content areas. 
Most current assessment methods reinforce 
the emphasis on these low-level skills and 
processing bits of information rather than 
on problem solving and critical thinking. 
The adoption of world-class standards would 
force the Nation to confront today's 
educational performance expectations that 
are simply too low. 
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Explicit and high performance standards 
could provide an appropriate yardstick 
against which students, parents, teachers, 
and others could measure individual and 
system progress toward the Goals. This 
information would also help to better 
direct the use of resources and time. 
Explicit standards would provide a common 
anchor for reforms in such areas as 
assessment, curriculum, instruction, and 
professional development, thereby promoting 
systemic rather than piecemeal reform. 

The United States enjoys a unique and 
complex blend of state and local control of 
education and national purposes for 
education. We propose to build on this 
system by setting in motion the appropriate 
mechanisms that will result in iQcal 
commitment to high national expectations 
for achievement for all studants. We do not 
propose a national curriculum. Standards 
would provide the basic understandings that 
all students need to acquire, but not 
everything a student should learn. 

Standards and assessments must be 
accompanied by appropriate federal, state, 
and local policies that seek to ensure high 
quality resources, including instructional 
materials and well-prepared teachers. The 
considerable technical and political 
challenges of going forward are detailed in 
the Council's report. While fully cognizant 
of these challenges, we urge the Nation and 
its leaders to move boldly and decisively 
toward implementation. We strongly endorse 
national education standards and a 
voluntary system of assessments as 
appropriate focal points in ongoing 
education reform. 

Sincerely, 




Carroll A. Campbell^ Jr. 

Governor of 
South Carolina 



Roy Romer 

Governor of 
Colorado 
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Executive Summaiy 



The National Council on Education Standards and Testing was 
created in response to interest in national standards and 
assessments by the Nation's Governors, the Administration, and 
Congress. In the authorizing legislation (Public Law 102-62), 
Congress charged the Council to: 

• advise on the desirability and feasibility of national 
standards and tests, and 

• recommend long-term policies, structures, and mechanisms 
for setting voluntary education standards and planning an 
appropriate system of tests. 

The work of the Council follows and complements the 
President's Education Sunmiit with the Governors held in 1989. 
This important collaborative effort led to th^} adoption of six 
National Education Goals designed to engage all Americans, 
from young children to adults. The National Education Goals 
Panel was created to report annually on progress toward the 
Goals. In its first year, the Panel concluded that to meaningfully 
measure progress on Goals c and 4, conrdderation should be 
given to creating national education standards that define what 
students should know and be able to do and to identifying and 
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National Education Goals 3 and 4 

G ^ 3: Stvdent Achievement and Citizenship 

By the year 2000, American students will leave grades four, 
eight, and twelve having demonstrated competency in 
challenging subject matter including EngUsh, mathematics, 
science, history and geography; and every school in America wiU 
ensure that all student learn to use their minds well, so they 
may be prepared for responsible citizenship, further learning, 
and productive employment in our modem economy. 

Goal 4: Science and Mathematics 

By the year 2000, U.S. students will be first in the world in 
science and mathematics achievement. 



developing methods to assess students' success in meeting 
them. The President similarly has called for the creation of 
World Class Standards for students and high-quality tests on 
which they can demonstrate achievement of these standards. 

In carrying out its charge to examine a broad range of issues, 
the Council met eight times between June and December, 1991. 
Task forces were created and produced background papers that 
informed the Councirs discussions. In response to the 
congressional call for broad public participation, the Council 
solicited and received public comment from experts and 
organizations representing a wide range of constituents and 
interests. This report to Congress, the Secretary of Education, 
the National Education Goals Panel, and the American people 
provides recommendations reached after intense deliberation 
and includes concerns that must be addressed as work 
progresses on developing standards and asses£:ments. 

Desirability of High National Standords and a 
System of Assessments 

In the course of its research and discussions, ihe Council 
concluded that high national standards tied to assessments are 
desirable. In the absence of well-defined and demanding 
standards, education in the United States has gravitated toward 
de j(U)to national minimum expecUitions. Except for students 
who are plaiming to attend selective four-year colleges, current 
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education standards focus on low-level reading aiid arithmetic 
skills and on small amounts of factual material in other content 
areas. Consumers of education in this country have settled for 
far less than they should and for far less than do their 
counterparts in other developed nations. 

High national standards tied to assessments can create high 
expectations for all students and help to better target resources. 
They are critical to the Nation in three primary ways: to promote 
educational equity, to preserve democracy and enhance the ci'/ic 
culture, and to improve economic competitiveness. Further, 
national education standards would help to pro\ade an 
increasingly diverse and mobile population with shared values 
and knowledge. 

The Council recommends standards for students and 
standards for schools and school systems. Student standards 
include specification of the content — what students should 
know and be able to do — and the level of performance that 
students are expected to attain — how good is good enough. 
The Council envisions that the national standards will include 
substantive content together with complex problem-solving and 
higher order thinking skills. 

To ensure that students do not bear the sole burden of 
attaining the standards and to encourage assurances that the 
tools for success v^l be available at all schools, the Council also 
recommends that states establish school delivery standards. 
System performance standards should also be established. 
School delivery and system performance standards would attest 
to the provision of opportunities to learn and of appropriate 
instructional conditions to enable all children to reach higli 
standards. 

In endorsing the concept of national standards for all 
students, the Council stipulates several characteristics these 
standards should have: 

• Standards must reflect high expectations, not expectations 
of minimal competency. 

• Standards must provide focus and direction, not become a 
national curriculum. 

• Standards must be national, not federal. 

• Standards must be voluntary, not mandated by the federal 
goverrmient. 

• Standards must be dynamic, not static. 
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The Councirs intent in recommending the establishment of 
national standards is to raise the ceiling for students who are 
currently above average and to lift the floor for those who now 
experience the least success in school, including those with 
special needs. States should work toward reducing gaps in 
students' opportunities to learn and in their performance, such 
as those now'associated with race, income, gender, and 
geographical location. 

Having reached consensus that standards are desirable, the 
Council then determined that it is not sufficient just to set 
standards. Since tests tend to influence what is taught, 
assessments should be developed that embody the new high 
standards. The considerable resources and effort the Nation 
expends on the current patchwork of tests should be redirected 
toward the development of a new system of assessments. 
Assessments should be state-of-the-art, building on the best 
tests available and incorporating new methods. In order to 
measure individual student progress and to monitor 
achievement in attaining the National Education Goals, the new 
system of assessments should have two components — 

• individual student assessments, and 

• large-scale sample assessments, such as the National 
Assessment of Educational Progress. 

The key features of both components would be alignment 
with high national standards and the capacity to produce useful, 
comparable results. In addition, the system of assessments 
should have a number of other features. 

• The system of assessments must consist of nmltiple 
methods of measuring progress, not a single test. 

• The system of assessments must be voluntary, not 
mandatory. 

• The system of asse^ssments must be developn\ontaI, not 
static. 

As these features are put in place, technical and (niuity issues 
need to be resolved, and tlie overriding importance of ensuring 
fairness for all children needs to be addressed. R(?solving issues 
of validity, reliability, and fairness is critical to the success of the 
new system. 

The Council concludes that the United States, with 
appropriate safeguards, should initiate the development of a 
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voluntary system of assessments linked to high national 
standards. These assessments should be created as 
expeditiously as possible by a wide array of developers and be 
made available for adoption by states and localities. The Council 
finds that the assessments eventually could be used for such 
high-stakes purposes for students as high school graduation, 
college admission, continuing education, and certification for 
employment. Assessments could also be used by states and 
localities as the basis for system accountability. 

In the Council's view, it is desirable that national content and 
performance standards and assessments of the standards be 
established. Doing so will constitute an essential next step to 
help the country achieve the National Education Goals. 
Moreover, developing standards and assessments at the national 
level can contribute to educational renewal in several ways. This 
effort has the potential to raise learning expectations at all levels 
of education, better target human and fiscal resources for 
educational improvement, and help meet the needs of an 
increasingly mobile population. Finally, standards and 
assessments linked to the standards can become the 
cornerstone of the fundamental, systemic reform necessary to 
improve schools. 

Feasibility of Creating National Standards and a 
System or Assessments 

As a first step, the (council recommends that standards be 
developed in the five core subject areas set out in the National 
Education Goals — English, mathematics, science, history, and 
geography — with other subjects to follow. The feasibility of 
settj'^g national standards and their effectiveness in prompting 
state and local refonn and experimentation is demonstrated by 
the work of several national professional organizations, a 
number of states, and other countries. The experiences of the 
National Council of Teachers of Mathematics (NCTM) and of 
several states demonstrate that standards-setting is feasible — it 
is being done. Slowly but surely across the country, stat(;s and 
local districts are respondmg to the NCTM standards by 
changing the curriculum and style of teaching to reflect the 
challenging new standards. The Council recommends national 
support for such efforts and encourages the work by 
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professional organizations, states, and localities in articulating 
standards, curriculum frameworks, and instructional guidelines. 

To make national standards meaningful, it is important that 
the Nation be able to measure progress toward them. New forms 
of assessments — tests worth teaching to — are envisioned. A 
system of student assessments linked to world-class standards 
would provide information that could be used to: 

• exemplify for students, parents, and teachers the kinds and 
levels of achievement expected; 

• improve classroom instruction and learning outcomes for all 
students; 

• inform students, parents, and teachers about student 
progress; 

• measure and hold students, schools, school districts, states, 
and the Nation accountable for educational performance; 
and 

• assist education policymakers with progranunatic decisions. 

It is unlikely that all of these purposes could be accomplished 
with the same assessment. Requirements for validity, reliability, 
and fairness necessitate on-going, independent reviews of the 
assessments and their uses. Further, particularly for children 
who have historicaUy experienced less success in schools, such 
as the poor, ethnic minorities, and students with disabilities, 
schools should ensure the opportunity to learn as a critical 
condition for valid and fair use of assessment results. 

Some existing assessments may be retained, while others will 
need to be replaced to avoid adding to the current patchwork. 
Pronusing efforts are under way nationally, as well as by states, 
localities, research institutions, and test publishers using new 
assessment methods to measure student progress against more 
demanding curriculum content. Investing in a national system of 
assessments could lead to more effective and economical use of 
available resources since it would provide direction and focus to 
reform efforts. The Council urges support for necessary 
research and development so that the critical need for assessing 
students against the yardstick of national, world-class standards 
can be met. 

The Council notes tliat if they are to be useful, comparable 
results should be available to all key levels, including individual 
students and their parents, schools, districts, states, and the 
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Nation. Assessment outcomes tied to the standa^'ds should be 
widely distributed and communicated in a form that is readily 
comprehensible to students, parents, policymakers, and the 
public. States and localities should report results in the context 
of relevant infonnation on the conditions of learning and 
students' opportuidties to learn. 

Developing and Implementing National Standards 
and a system of Assessments 

To ensure that development of national standards and a 
voluntary system of assessments is done effectively, a 
coordinating structure needs to be agreed upon and put into 
place. This structure should benefit from and not duplicate work 
already being done by existing entities. The Council 
recommends that a reconfigured National Education Goals 
Panel and a newly created National Education Standards and 
Assessments Council work jointly to certify content and student 
performance standards and criteria for assessments as world 
class. The Council fiirther recommends that to ensure strong 
public accountability in this work the Panel would appoint 
members of the National Education Standards and Assessments 
Council, which would have the responsibility to coordinate this 
national effort. 

High national standards and a system of assessments, while 
critically important, are not panaceas for the Nation's 
educational problems. Other required elements of reform 
include state curriculum frameworks tied to the standards, 
professional development opportunities for teactiing to the 
standards, new roles and responsibilities for educators, 
technology that enhances instructional opportunities, assistance 
to families and communities in need, incentives to inspire better 
efforts by students and educators, early intervention where 
problems are identified, and the reduction of health and social 
barriers to learning. 

Conclusion 

The country is engaged in a national debate on what students 
should know and be able to do and on how to measure 
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achievement tovard those ends. This debate is part of a 
fundamental shift of perspective among educaton 
policymakers, and the public from examining inp. .a and 
elements of the educational process to exanrdi^ing outcomes and 
results. The Council initially discussed standards and 
assessments as a way to help measure progress toward the 
National Education Goals but came to see the movement toward 
high standards as a means to help achieve the Goals. 

While mindful of the technical and political challeng.is, the 
Council concludes that national standards and a system of 
assessments are desirable and feasible mechanisms for raising 
expectations, revitalizing instruction, and rejuvenating 
educational reform efforts for all American schools and 
students. Thus, the National Council, on Education Standards 
and Testing endorses the adoption of high national f landards 
and the development of a system of assessi aeats to measure 
progress toward those standards. 
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„Part One 



Are National Standards 
and a System of 
Assessments Desirable? 



The Council finds that setting national standards and 
developing a system of assessments measuring progress toward 
the standards are desirable. The Council discussed national 
standards and a system of assessments as a means of tracking 
progress toward the National Education Goals. Standards and 
assessments are important tools to help the Nation achieve the 
Goals by raising expectations and providing information so that 
available resources can be better targeted, hi addition, national 
standards and a system of assessments tied to them can play key 
roles in addressing three national priorities. First, they can help 
us extend the opportunity for a high quality education to all 
Americans. Second, they can strengthen democratic institutions 
and values while enabling all citizens to participate more 
effectively in the political process. Third, they can enhance 
economic competitiveness by improving the Nation s human 
capital — the abilities and skills of the country's workers and 
entrepreneurs. 
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The Need for National Standards and a System of 
Assessments 



Equitable Educational Opportunity for All Americans 

High national education standards and a system of assessments 
to measui^e their attainment can play a vital role in raising 
expectations, especially for youngsters from groups that have 
historically experienced less academic success. While the 
Council recognizes that new standards and assessments alone 
are not a complete education reform strategy, world-class 
standards and quality assessments can be powerful catalysts for 
implementing the systemic change necessary to bring all 
students, leaving no one betrnd, to high performance standards. 
The Council has concluded that standards and assessments have 
the potential to boost the performance of students who are 
currently above average as well as those who are now the least 
successful* By emphasizing their applicability to all students, 
standards and assessments will help assure that adequate 
resources are available and appropriately targeted to helping all 
students attain the standards. 

To achieve this ambitious purpose, there are three important 
considerations. First, poor initial performance should not be 
used to divert students into less demanding courses with lower 
expectations but rather must lead to improved instruction and 
redoubled effort. Second, policymakers should seek to ensure 
that schools provide all their students with opportunities to 
master the demanding new material in the standards in an 
atmosphere where achievement is prized. Tliird, students with 
disabilities or of limited English proficiency should be provided 
opportunities to learn and to demonstrate their mastery of 
material under circumstances that take into account their 
special needs. 

Enhancing the Civic Culture 

High-quality national standards and a system of assessments 
have the potential of helping all students acquire the necessary 
knowledge, skills, and shared values to deepen and renew our 
civic culture and of enabling all citizens to participate more 
effectively in the political processes of democracy. In recent 
decades, the population has grown increasingly diverse. The 
Council carefully considered the concerns that standards and 
assessments might have the effect of homogenizing the culture. 

liaising Standards for American Education 




It is the Council's intent that the standards reflect and be 
enriched by the Nation's pluralistic heritage as well as its shared 
democratic values and institutions. 

Two important considerations have helped shape a number of 
the Council's recommendations. First, the Council decided that 
the standards should not be used as a national curriculum. 
Rather, they should serve as a basic core of important 
understandings that all students need to acquire, but certainly 
not everything that a student should learn. States and local 
jurisdictions need to retain the capacity to include a substantial 
amount of additional material reflecting their particular interests 
and emphases. Second, the system of assessments the Council is 
recommending is not a single national test. Instead, states, 
individually or collectively, will be encouraged to develop or 
acquire their own instruments to assess progress toward the 
national standards. In these important ways, the Nation's legal 
and historical traditions of state and local control of education 
are preserved while still developing common ground on key 
aspects of education that are vital for all Americans. 

The United States has historically demonstrated a remarkable 
ability to bind together a v^de variety of groups into one nation. 
A common understanding of the knowledge and skills future 
generations of citizens should possess has the potential to serve 
as a powerful force for national unity, social vitality, and cultural 
vibrancy. 

Economic Competitiveness 

High standards for student attainment are critical to enhancing 
America's economic competitiveness. The quality of human 
capital, the knowledge and skills of labor and management, 
helps determine a nation's ability to compete in the worid 
marketplace. International comparisons, however, consistently 
show that the academic performance of American students is 
below that of students in many other developed countries. The . 
relative deficiency in America's human capital contributes to the 
inability of many firms in the United States to compete 
internationally. Low skill levels may also be impeding American 
business from sliifting to newer, more efficient methods of 
production that require greater responsibility and skill on the 
part of front-line workers. These deficiencies likely affect the 
standard of living of all Americans, but the effects arc felt most 
keenly by those who do not have adequate sldlls. The Council 
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thus concludes that world-class standards for student 
performance and a way of assessing progress toward them can 
be part of education's contribution to addressing the Nation's 
deficit in human capital and increasing competitiveness in the 
global marketplace. 

The Council finds, as do many in the business community, that 
standards set in specific academic subject areas should include 
the type of useful workplace skills described in the U.S. 
Department of Labor's SCANS (Secretary's Commission on 
Achieving Necessary Skills) report. In addition to the academic 
knowledge identified in the SCANS report, skills and personal 
qualities, such as acquiring and evaluating data, working in 
teams, monitoring and correcting performance, self- 
management, solving problems, and knowing how to learn are 
important for success at work. To the extent possible, these 
types of skills can and should be integrated into the national 
standards and assessments. Together with high-quality technical 
training and the broad knowledge provided by a solid academic 
education, such skills can go a long way toward creating the 
literate and competent workforce necessary for a productive 
economy. 



National Standards and n System of Assessments 

The Council has come to the conclusion that developing high 
national standards and a system of assessments measuring the 
degree to which they are attained has the potential to provide 
families, educators, and policymakers with the information 
necessary to mak(^ wise educational decisions. 

In the absence of demanding content and performance 
standards, the United States has gravitated toward having a de 
facto minimal skills curriculum. The many state minimum 
competency tests, the lower level skills orientation of most 
textbooks, and state and local policies that do not adequately 
promote quality are examples of this minimal approach. The 
Council finds that what has been demanded is insufficient in that 
it covers far too little of the knowledge and skills students need 
to succeed in the modern workplace and to participate in the 
democratic process. Such low expectations shortchange 
students and ill-serve the country. Yet as long as today's low 
standards remain in pla^;e, the performance of the majority of 
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Calif omia Overarching 
Statement on Mathematics 

Mathematical power, which involves the ability to discern 
mathematical relationships, reason logically, and use 
mathematical techniques effectively, must be the central 
concern of mathematics education and must be the context in 
which slriUs are developed. 



Excerpted from: California Mathematics Framework, 
California State Department of Edmation, ( 1992 ), 



students is unlikely to improve substantially. 

Standards developed at the national and state levels should 
have a number of specific components: 

• An overarching statement for each subject area to provide 
a guiding vision of its content and purpose; 

• Co7itent standards that describe the knowledge, skills, and 
other understandings that schools should teach in order for 
students to attain high levels of competency in challenging 
subject matter; 

• Student perfomimice standards that define various levels 
of competerne in the challenging subject matter set out in 
the content standards; 

• School delivery standards developed by the states 
collectively from which each state could sehct the criteria 
that it finds useful for the purpose of assessing a schooFs 
capacity and performance; and 

• System perfonrtance standards that provide evidencie 
about the success of schools, local school systems, states, 
and the Nation in bringing all students, leaving no one 
behind, to high performance standards. 

The ('ouncil concludes that national standards should have 
the following characteristics: 

» Hixjh expectations — not expectations of rriinirmil 
competency. The (Council noted that educational 
expectations are currently too low and that, as a result, too 
many American students perform accordingly. Setting 
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NCTM Standard 5: Algebra 

In grades 9-12, the mathematics curriculmT^ shotdd include the 
continued study of algebraic concepts and methods so that all 
students can- 

• represent situations that invoive variable quantities with 
expressions, equations, inequalities and matrices; 

• use tables and graphs as tools to interpret expressions, 
equations and inequalities; 

• operate on expressions and matrices, and solve equations and 
inequalities; 

• appreciate the power of mathematical abstraction and 
symbolism; 

and so that, in additi^on, college-intending students cm- 

• use matrices to solve linear systems; 

• demonstrate technical facility with algebraic transformations, 
including techniques based on theory of equations. 



Excerptedfrom: Curriculum and Evaluation Standards for 
School Mathematics, Natimuil Council ofTeach£rs of 
Mathematics. (1985). 
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world-class standards will purposefully address this 
deficiency. Students, regardless of background, will be 
challenged to meet these high standards, 

• Focits and direction — not a national curriculum. 
Standards set would be neither exhaustive nor all inclusive. 
They should be viewed as a common core that would be 
enhanced through considerable state and local flexibility. 
Within the bread framework of the standards, schools and 
teachers would have the discretion to develop their own 
detailed curricula, determine subject sequencing, choose 
materials, select pedagogy, and add content reflecting local 
and state interests and diversity 

• Nat'>onal—not federal. The standards, arrived at through 
consensus, will be national in character and applicability. It 
would be inappropriate for the federal government to create 
or mandate the new standards. Standards-setting must 
involve the widest possible participation in the process from 
individuals and groups at the national, state, and local levels, 
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as Congress has noted in the legislation establishing this 
Coimcil. 



Voluntary — not mandatory. Adopting the national 
standards will be voluntary. The Council anticipates that 
high-quality standards, developed through a broad and open 
process, will be widely used. 

• Dynamic — not static. While care should be taken to 
develop quality standards from the outset, the process will 
be ongoing, entailing improvement and refinement over time 
in order to remain world-class. It is imperative that 
standards keep pace with the development of knowledge in 
the subject fields. 

To make standards meaningful, the Council has determined 
that a system of assessing students' success in attaining them is 
desirable. A national system of assessments should be created 
that contains two components: student assessments that can 
provide results for individual students; and large-scale sample 
assessments, such as the National Assessment of Educational 
Progress (NAEP). The key features of both components would 
be alignment with national content and performance standards 
and the capacity to produce useful, comparable results that are 
available to all key levels, including students and their parents, 
schools, districts, states, and the Nation. To assist in developing 
informed judgments on performance, states and localities 
should report results in the context of information such as 
opportunity to learn and relevant conditions of learning. 

A national system of assessments should also iiave the 
following features — 

• Multiple assessments — not a single test. It will be up to 
states, individually or in groups, to adopt assessments linked 
to the national standards. States can design the assessments 
or they may acquire them. 

• Voluntary — not rmndatory. State participation in the 
national system of assessments will be voluntary. The 
federal government will not require that states adopt any 
particular tests. 

• Developmental — 7iot static. The system should be 
developmental. It should change and evolve over time, 
maintaining alignment with the national content and 
performance standards and incorporating improved 
assessment techniques as these are developed. 
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Assessments must address important technical issues of 
reliability, validity, and fairness. Professional standards exiRt for 
resolving many of these issues. Particular attention must be paid 
to the reliability, validity, and fairness of assessment instruments 
and testing conditions when high stakes for students or 
educators are attached to test results. 

The Role of National Standards and a System of 
Assessments in Education Reform 

A national initiative to develop world-class standards and a 
system of high-quality assessments that measure progress 
toward them is vital, for reforming American education, for the 
following reasons. 

American education would be well served by an organized 
attempt to provide direction on a nationwide basis and to 
determine some of the important skills and knowledge that all 
students should master at key stages in their education, without 
trying to specify a national curriculum. Articulating standards 
and developing assessments that provide educators an(i 
students with targets toward which to marshal their efforts can 
contribute to more efficient use of available resources. 
Educators place different emphases on what studt^nts should 
le.-rn at various points in their schooling. In an increasingly 
mobile society, many students attend a number of different 
schools over the course of their education, often in different 
conun unities or states. Frequently, teachers do not know what 
they can reasonably expect students to have learned belore 
entering their classrooms and cannot bo sure what will be taught 
afterward. The Council concludes that these educational 
problems are national in sc.-ope and would be addressed best 
through a nationally coordinated effort. While respecting local 
and regional diversity, su(;h an (Effort coukl take advantage of the 
useful work already under way in many states and localities, 
sharing lessons and avoiding unnecessary duplication. 

New standards and assessments that provide information 
useful to improving instruction and student learning woukl likely 
be perceived as valuable tools by many teachers. In the absence 
of national standards, the results from current standardized 
assessments are sometimes more a source of confusion than a 
tool for improving instruction. Teachers sometimes feel 
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pressured by the consequences attached to test results to 
narrow instruction and focus on the minimal skills measured by 
some current tests. Many of these tests are not designed to 
guide instruction. The Council notes that recent assessments 
have explored alternative ways of measuring what students are 
to learn, and new efforts should build on the important work 
now under way. 

More accurate and dependable sources of information on 
progress toward achieving the National Education Goals would 
be an important incentive to change education. The Council 
recommends that reliable and comparable data on the 
performance of students against meaningful standards be 
available to five important levels in education: individual 
students and their parents, schools, districts, states, and the 
Nation. Families want and need comprehensible information on 
students' progress toward high standards. To exercise informed 
judgment, educators and policymakers similarly need reliable 
data on student progress in meeting high-quality standards as 
well as information on other outcomes. The Council concludes 
that a national effort to set standards and coordinate the 
development of a system of assessments could provide data that 
are both high quality and comparable. 

The Council further finds a need to shift the basis of 
educational accountability away from measures of inputs and 
processes to evidence of progress toward desired outcomes. 
Given the substantial outlay of public funds on elementary and 
secondary education in the United States, elected officials and 
policymakers have understandably been concerned with 
ensuring that taxpayers' dollars are well spent. Unfortunately, 
the lack of high standards and quality assessments that measure 
progress toward them has in the past resulted in accountability 
being tied primarily to complianc(? with rules and regulations or 
to data from assessments measuring only minimal skills. The 
Council believes that accountability needs to be refocused 
toward performance. This is espc^cially true wh(*re 
consequences for students or educators are attached to 
performance on these measures. 

The Council finds that a nationally coordinated initiativ(* 
would result in high-quality outcome measures that can be used 
for accountability A national effort would address squarely the 
necessary technical issues of developing assessments that are 
valid, reliable, and fair. Ui tprecedented national attention — by 



January 2k, 1992 




17 



testing experts, educators, policymakers, and the public — 
could be focused on the system of assessments and use of the 
results for accountability. 

Standards and assessments can serve as catalysts for raising 
expectations. In many states and localities, the minimun\ 
competency skills standards put in place in the 1970s and early 
1980s resulted in changes that have helped many youngsteis 
attain at least these low-level skills. The work of the National 
Council of Teachers of Mathematics to create content standards 
in mathematics has already influenced the development of s^nte 
curriculum frameworks and asse»ssments. The College Board 
Advanced Placement program's course guides and examinations 
are widely recognized as valuable and useful tools that have 
helped to provide quality instruction to millions of students 
across the country. In California, curriculum and asfiicssment 
reforms are the cornerstone of a strategic education plan that 
includes changing professional development, instructional 
methods, textbooks, technology, and other classroom materials. 

Setting standards and developing quality assessments of 
progress toward them should be a national effort. An 
increasingly global economy requires that national standards be 
set at world-class levels. Such an unprecedented initiative in this 
country must find its way through uncharted waters relating to 
difficult technical and policy issues. Undertaking this effort at 
the national rather than state or local levels can help to achieve 
cost-effectiveness and marshal the talent and scarce public 
resources needed to deal adequately with these issues. 

The Council finds a quality system of national standards and 
assessments embodying the important qualities discussed in tliis 
section to be highly desirable. Given that education serves 
imporc:ant national purposes, including equitable opportunity for 
all Americans, enhancing the Nation's civic culture, and 
improving the economic competitiveness of the United States, 
and because many of the difficulties of developing high-quality 
standards and assessments can be addressed best at the national 
level, the Council recommends a coordinated national effort that 
respects local prerogatives and diversity in educating students 
to world-class levels. Such an effort is the necessary next stp.p in 
achieving the ambitious National Education Goals and has the 
potential to spur a nationwide process of educational renewal. 
Rather than threaten local autonomy, standards and 
assessments can support efforts to improve the quality of 
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education. Standards and a national system of assessments 
would provide those designing state curriculum and testing 
systems with a valuable resource developed through a national 
consensus process. They further provide a focus on improving 
student performance and could lead to more effective and 
efficient allocation of resources at the local, state, and national 
levels. 
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Part Two 



Is it Feasible to Develop 
National Standards and 
a System of 
Assessments? 



T 

ihe Council finds it feasible as well as desirable to create 
national education standards and a system of assessments 
linked to the standards. Precedents set by stat(^s, localities, 
professional organizations, and other groups demonstrate that 
this undertaking is feasible. 



Setting Standards in Subject Areas 

The process of setting standards is at various levels of 
development in the five subjects emphasized in the National 
Education Goals and should be expanded into other subjects, 
such as citizenship education, foreign languages, and the visual 
and performing arts. Attention should also be given to 
developing standards for the application of knowledge to 
complicated, real world problems that demand integrating 
student knowledge from several disciplines. The Council 
recommends that standards be developed through a broad- 
based process that involves educators, including scholars in 
each field. Teachers should play a key role in this process. So, 
too, should reprt?sentatives of business and the public. The 
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English in Maine's Common 
Core of Learning 

Students', with a common core of knowledge... 

• Are familiar with contemporary and enduring works of 
AmeHcan literature and have a sense of how important themes 
of American experience have developed through time 

• Are familiar with works of diverse literary traditions — works 
by women and men of many racial, ethnic, and cultural groups 
in different times and parts of the world, including 
Shakespeare, the Bible as literature, and classical mythology 

• Communicate clearly — orally, in writing, and with graphics 

- Have a strong command of standard oral and written 
language conventions 

- Demonstrate basic proofreading and editing skills 

- Use handbooks and reference books to locate language 
terminology and rules 

Excerpted from: Maine's Common Core of Learning: An 
Investment in Maine's Future. 



standards-setting process should be informed by work in other 
industrialized countries in order to ensure that the new 
standards are world class. 

The process envisioned is a dynamic one with standard^i 
updated to meet changes in scholarship and to remain world 
class. Work that is under way demonstrates empirically that 
standards-setting is feasible and that the process itself may 
contribute to educational renewal. The National Assessment 
Governing Board's process for developi^:-? guidelines is an 
example of professional consensus-building and nationwide 
participation. The Council recommends that national education 
standards build upon the following current professional efforts. 

English 

Literature is the subject matter specific to the English 
curriculum. Reading and wilting, speaking and listening are 
conununication skills that underiie^ it. The content and processes 
of the English curriculum enrich life experiences, increase 
einployability, and enhance communication. Standards 
developed in this subject have broad applicability iri eveiy 
subject of the curriculum. 
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All students, regardless of background, should have access to 
both the content and processes of the English curriculum and be 
able to respond thoughtfully and knowledgeably about a wide 
variety of major works of high-quality literature. Students 
sometimes have not been introduced to literature because the 
focus has been on the basic skills. Often, v^iting is little more 
than filling in the blanks or composing a single sentence. 

Important work has been done in this area by a number of 
states and organizations. For example, the assessment 
frameworks for reading and writing created by the National 
Assessment Governing Board for the National Assessment of 
Educational Progress (NAEP) and the curriculum guidelines 
crfxted by the state of Maine may be useful to examine in any 
standards-setting effort. 

AAalhemaHcs 

All students need a solid foundation in mathematics that goes 
beyond simple arithmetic and includes analytical and problem- 
solving operations. Of all the subject areas, mathematics is now 
the one in which the United States is farthest along in the 
standards-setting process. The National Council of Teachers of 
Mathematics has developed curriculum standards through an 
extensive iterative process with broad public input and 
professional review that has resulted in unprecedented 
consensus. These are gaining wide acceptance in education and 
in the public arena as a framework for the mathematics that 
schools should teach. 

Defining standards for levels of student mathematics 
performance — what knowledge and skills students should 
master — still remains to be done. That process should build 
upon the important work under way in many states and 
countries. 

Science 

Given the fast pace of technological development, ail students 
need a firm grasp of the concepts and thinking skills involved in 
science. Students can learn information about the world around 
them in a manner that also teaches them to reason and 
investigate scientifically. 

With the support of the U.S. Department of Education, the 
National Academy of Sciences has recently started a major effort 
to develop world-class standards for what students should know 
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Science For All Students 

• World non^' 'or what constitutes a basic education have 
changed raujcally in response to the rapid growth of scientific 
knowledge and technological power. 

• Sweeping changes in the entire educational system from 
kindergarten through twelfth grade will have to be made if the 
United States is to become a nation of scientifically literate 
citizens. 

• A necessary first step in achieving systematic reform in 
science, mathematics, and technology education is reaching a 
clear understanding of what constitutes scientific literacy. 



Excerptedfram: Science For All Americans: A Project 2061 
Report On Literacy Goals in Science, Mathematics, and 
Technology, Amerkan Association for the Advancermnt of 
Science. (1989). 



and be able to do in science. Such promising work as that of 
Project 2061 of the American Association for the Advancement 
of Science (AAAS), the NAEP science framework, the National 
Science Teachers Association's Scope, Sequence and 
Coordination projects, and several state science frameworks 
will form the basis of the consensus-building activity to be 
conducted by the National Academy of Sciences. 

History 

Understanding the past provides a context for understanding 
the present. The study of history is more than a superficial 
recognition of names and dates. It involves indepth knowledge of 
the important people, ideas, events, and trends thu" have helped 
to shape the world. In addition to major political events, history 
includes such areas as social and economic developments over 
time, civics, art and music, and the history of ideas. The links 
between history and geography should be explicit and should 
demonstrate the roots of events in time and place. Knowledge of 
the history of other nations and their cultures broadens 
students' perspectives. A solid grasp of America's history 
teaches students an appreciation for both the diversity and the 
shared experiences and values that have given the United States 
its unique character. 

Given the size and diversity of the country, it is difficult to 
craft a plan for history education that balances pluralism and 
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From the California History- 
Social Science Framework 

We want ouv students to understand the value, the 
importance, and the fragility of democratic institutions... to 
develop a keen sense of ethics and citizenship, and to care 
deeply about the quality of life in their community, their nation, 
and their world. 

Excerptedfrom: California History-Social Science Framework, 
California State Department of Education. (1987), 



common values. In California, a state uith a very diverse 
population, the History-Social Science Framework has been 
widely acclaimed for scholarly integrity and multicultural 
perspective. The National Center for History in the Schools at 
UCLA has embarked on a two-year effort to develop world-class 
history standards v^th support from the National Endowment 
for the Humanities and the U.S. Department of Education. 

Geography 

Educated citizens need to understand their geographic setting 
in the world and that of other peoples. Geography, understood 
broadly, includes historical, political, social, economic, and 
physical interaction with the Earth and its environment. 

What we now expect our students to know in geography is 
minimal when compared to what other developed nations 
expect of their students in this subject. There is substantial 
concern about the negative consequences this may have for our 
ability to market American goods and services in different parts 
of the world. 

World-class standards should be developed in geography, 
broadly defined. The leadership of the National Geographic 
Society has provided impetus for work on setting guidelines, 
designing new materials, and providing professional 
development opportunities for teachers. The Guidelines for 
Geographic Education, developed by the National Council for 
Geographic Education and the Association of American 
Geographers, would be worth examining in the course of setting 
standards for this subject. 
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Geography is Vital 

Air ?ricans' ignorance of their own country and of the world 
will have dire consequences for our nation's welfare, strength, 
and global interdependence and for the effects we have on 
people in other nations. Our very livelihoods depend upon 
products, ideas, and even weather and climate that originate 
great distances from where we live and work. In a democracy 
the development of compassionate and effective public policies 
depends upon active participation of citizens who are broadly 
educated about their own society and its relations with the 
entire world. All events affecting society occur within a 
geographic context. To understand these events fully we must 
subject them to geographic scrutiny. 



Excerpted from: Guidelines for Geographic Education: 
Elementary and Secondary Schools., Joint Committee on 
Geographic Education of the National Council for 
Geographic Education and the Association of American 
Geographers. (1984). 



Toward a System of Assessing the Notional 
Standards 

To make national standards meaningful, it is important that the 
Nation be able to measure progress toward them. The Council 
recommends a system of multiple assessments linked to the 
national standards that will measure the progress of individuals, 
schools, districts, states, and the Nation. 

The system of assessments would have two major 
components: individual student assessments and assessments of 
representative samples of students from which inferences about 
the quality of programs or educational systems could be made. 
The National Assessment of Educational Progress (NAP]P) is an 
example of a large-scale sample assessment. Both components 
would be aligned with the national standards. 

Purposes of Assessment 

In endorsing assessments to monitor individual and system 
progress toward the national education standards, the Council is 
advocating a system that will provide information for the 
following purposes: 
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• to exemplify for students, parents, and teachers the kinds 
and levels of achievement that should be expected; 

• to improve classroom instruction and improve the learning 
outcomes for all students; 

• to inform students, parents, and teachers about student 
progress toward the standards; 

• to measure and hold students, schools, districts, states, and 
the Nation accountable for educational performance; and 

• to assist in education program decisions to be made by 
policy makers. 

The Council notes that it is unlikely that all of these purposes 
can be accomplished with the same test or assessment 
instrument. 

Individual Student Assessments 

New student assessments will need to be developed by states, 
districts, commercial publishers, and others in order to measure 
student performance against the national content and 
performance standards. To facilitate the sound development of 
such new assessments, the Council recommends the following: 

• New student assessments should incorporate the best 
thinking and sound research and development. 

• States should work together in developing assessment 
instruments in order to use resources effectively and to 
improve the quality of the assessments. 

• States and others should examine various approaches in 
designing student assessments of the national standards and 
also develop innovative methods of administration and 
improved procedures to report to their multiple audiences. 

• Different assessments may bo developed for different 
curricula. There wil) be diverse interpretations of the 
content standards that lead to differing curricula and 
teaching practices. 

• High sUikes should not be associated with the results of any 
assessment until the qualities of validity, reliability, and 
fairness have been addressed. 

The Council finds, however, that the assessments eventually 
could be used for such high- stakes purposes for students as high 
school graduation, college admission, continuing education, or 
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certification for employment. Assessments could also be used by 
states and localities as the basis for system accountability 

Assessments of Samples of Students 

The Council recommends that the National Assessment of 
Educational Progress (NAEP) be reauthorized and assured 
funding to monitor the Nation's and states' progress toward 
Goals 3 and 4. of the National Education Goals. NAEP is the 
national program begun in 1969 to biannually test representative 
samples of students in grades 4, 8, and 12 in core subject areas 
and report achievement trends ov^r time. As national standards 
are developed, there should be efforts to ensure that NAEP will 
be aligned with these standards. 

Technical Issues Associated w^th Improving Assessments 

Currently, a substantial amount of testing is conducted in 
schools. It is frequently said that American students are tested 
more than others in the world. Despite all the tests, surprisingly 
little useful information is available to students, parents, 
educators, and policymakers. Dissatisfaction with shortcomings 
in present practices has led to a ricn variety of efforts to improve 
assessments. A national effort is needed to facilitate and 
coordinate these acti"ities. 

The new assessments should challenge all students and 
educators to do their best, open up new opportunities for 
students, and provide real incentives to improve the quality of 
America's schools. There is significant interest in the promise of 
performance-based assessments, such as portfolios and 
projects, as ways of Lollecting evidence of what students know 
and can do. Such as:jessments frequently use open-ended tasks, 
focus on higher order or complex thinking skills, require 
significant student time, and may allow students to choos(> 
among alternative tasks; some examine the perfonmance of 
group activities. While important issues remain to be resolved, 
innovative techniques used by states and localities may be 
important elements in the mix of assessment instruments that 
will make up the new national system. 

Import^mt technical difficulties confront those developing 
such a new system of assessments. The Council deliberated on 
these complexities and recommends that special precautions be 
taken in the development process. First, any system must honor 
the traditions of local and state responsibility for education and, 
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Grading the Advanced 
Placement Examination 

Advanced Placement grading procedures were developed with 
certain features intended to ensure high score reliability. There 
is a "Chief Reader" who has primary responsibility for the 
grading in each subject. In consultation with the test 
development con;mittee, the Chief Reader creates a tentative 
set of standards by which the answers are to be judged. The 
Chief Reader oversees all the other "Readers'* in that subject. In 
most subjects, the Chief Reader receives help in assigning 
grades from those who designed the questions and others so as 
to ensure that the standards are being applied consistently. 
Readers are trained by grading "samples" ~ copies of actual 
answers distributed among all Readers of the same section of 
the exam. 

The reading and scoring of "live" papers does not begin until 
consistency has been achieves » ^ the grading of the samples. 
Throughout the grading, samples are used daily at frequent 
internals to ensure that the scoring remains uniform, A constant 
check of random papers from each Reader is made to further 
ensure consistent application of the standards. Grading 
reliability studies are conducted for all examinations. 

The final grade on an examination is the composite of the 
score on the multiple-choice section plus the scores given by the 
Readers, weighted and combined. Using guidelines established 
for this purpose, the total composite score is translated by the 
Chief Reader into the scale used for reporting the grades: 1 
through 5 (5 = extremely well qualified; 4 = well qualified; 3 = 
qualified; 2 = possibly qualified; 1 = no recommendation). 



SumTmrizedfrom: School Administrator's Guide to the 
Advanced Placement Program The Advanced Placement 
Program, The College Board, (EditicmH). 



consoquontly, must provide flexibility and room for local 
adaptation. Second, there are difficulties in producing 
assessments of high technical qaality and fairness. Third, 
acknowledging that an assessment system of the scop(? imagined 
is a ne w (enterprise for the Nation, care must be taken to avoid 
the unintended and undesired effects of sonu? testing practices, 
such as narrowing instruction and excluding certain students 
from assessments. Sufficnent safeguaixis must be built into th(^ 
system to protect students from negative consequences while 
the system of assessments is being refined, especially for 
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students who have not been well served by testing in the past. 

It will be technically difficult but essential to ensure that new 
assessments are valid, reliable, and fair This requires ongoing 
reviews of the emerging assessments and their uses. Further, 
particularly for children who have historically experienced less 
success in school — such as the poor, ethnic minorities, and 
students with disabilities — opportunity to learn is a critical 
condition for valid and fair use of assessment results. 

FirshRate System of Assessments 

The development of a first-rate system of assessments will be an 
evolutionary, ongoing process. The Council finds the following 
activities to be crucial in this effort: 

• Quality assurance. The Council recommends a quality 
assurance process to ensure that new student assessments 
are appropriate measures of the national standards and 
meet the technical considerations of validity, reliability, and 
fairness, particularly in conjunction with any high-stakes 
uses. Judgments of validity, reliability, and fairnoss depend 
in part upon how the results of the assessments are used. 

• Quality guidelines for assessment dcvelopnunit. The 
Council recommends quality guidelines for the development 
and use of student assessments such as the Standards for 
Educational and Psychological Testing and the criteria 
described by the National Forum on Assessment. Revised 
and additional guidelines may be needed as work 
progresses. 

• Comparability, The Coimcil finds it essential that different 
assessments produce comparable re^sults in attainment of 
the standards. 

• Coherent and informative results. One key objective of 
the assessment effort is to provide acc:urate information for 
students, parents, and teachers about the (educational 
progress of individual students; another is to infor n the 
public about the national achievement level. For students, 
parents, and teachers, the ir^tioiial system of assessments 
should provide information about an individual student^s 
performance against national standards. States and localities 
should report results in the context of the conditions of 
learning and students' opportunities to learn. 
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•Independent reviews. The Council recommends periodic, 
independent reviews of the assessment system to examine 
its impact, to ensure alignment with the national standards, 
and to ensure comparability of results. 

• Better knowledge base. The Council recommends 
continued research on developing, interpreting, and 
reporting assessments and ensuring test comparability 

• Cost ejfectiveness. Detailed cost estimates for a new system 
of assessments are not available, but the Council 
recommends that assessments be cost effective. They 
should seek to build on current efforts at the state and local 
levels. The Council does not intend that the assessment 
system add to the net burden of testing, but rather that 
much current testing be replaced. 

The Council finds precedents which indicate setting high 
standards and developing a quality system of assessments can 
raise student achievement. The Council advocates moving ahead 
to create high national standards and a voluntary system of 
assessments with careful and ongoing oversight of the process 
and its results. 




How Are National 

Standards and a System 
of Assessments to be 
Developed and 
Implemented? 



A he Council rocoinmends that a coordinating structure be p 
in place to advance standards-setting and assessment 
development. Development and implementation of national 
standards and a system of assessments should not take place in 
isolation but should be part of comprehensive educational 
reform. Indeed, the intellectual and political activities of setting 
high national standards and developing assessments are likely to 
provide added momenturti for higher expectations and 
educational renewal. 

Proposed Coordinating Structure 

The Council has agreed that the Nation should move forward to 
set national education standards and develop a voluntary 
national system of assessments to help students and schools 
meet those standards. To ensure that this is done effectively, a 
coordinating structure needs to be agreed upon and put into 
place. 
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Principles 

• Non-Federal. To maintain the Nation's tradition of state and 
local authority over education, any new oversight entity 
should be part of a cooperative national effort. 

• Non-Duplication. The process should benefit from and not 
attempt to duplicate work being done by existing entities. 

• Broad-Based. The coordinating structure should be 
bipartisan, engage government at all levels, and involve the 
many constituencies that have an interest in improving 
education. 

• Accountability. The coordinating structure must 
nevertheless be accountable to the public. In addition to a 
public appointment process, appropriate constraints on 
rules of deliberation, reporting, and contracting can help 
provide such accountability. 

• Timing. ^h good work has already begun and much more 
needs to be done soon. The coordinating structure should be 
in place quickly and act as a catalyst for progress rather than 
retard current efforts. 

Functions 

A number of functions need to be performed to achieve the 
development of standards and assessments. They are described 
as follows: 

Standards 

• Coordinate the development of national standards 

• Develop an overarching statement 

• Develop content standards 

• Develop student performance standards 

• Develop school delivery standards 

• Develop system performance standards 

• Certify content and student performance standards as world 
class 

Assessments 

• Coordinate the development of a system of assessments for 
individual students connstent with the national standards 

• Develop a program/system monitor consistent with national 
standards 
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• Provide research and development for break-the-mold 
assessments 

• Issue guidelines for assessments 

• Ensure technical merit (validity, reliability, fairness) 

• Certify assessments 

• Establish procedures and criteria for achieving 
comparability 

Structure 

The National Education (loals Panel would be reconfigured to be 
politically balanced. Representation would include two members 
from the Administration; eight Governors with three from the 
same political party as the President appointed by the chair or 
vice chair of the National Governors' Association, whichever 
represents the same political party, in consultation with each 
other; four members of Congress appointed by the majority and 
minority loaders of the U.S. Senate and U.S. House of 
Representatives. The role and function of the Panel would 
remain the same as set out in its charter. In addition, it will 
appoint members to a newly created body called the National 
Education Standards and Assessments Council, and it will 
certify standards and criteria for assessments. 

Work on several of the functions identified above has already 
begun. For instance, professional groups in the five disciplines 
are developing national content standards with financial support 
from the U.S. Department of Education's Office of Educational 
Research and Improvement, the National Endowment for the 
Humanities,National Science Foundation, and other existing 
federal and non-federal ag(?ncies. The National Assessment of 
Educational Progress, with oversight by the National 
Assessment Governing Board, is developing assessments which 
would function as the program/system monitor; and the federal 
government is funding through the Office of Educational 
Research and Improvement important research and 
development for break-the-mold assessments. This work would 
contiime and in fact would need to be augmented and 
accelerated. Other work, such as the school and system 
standards, would be developed by states working collectively 
through organizations like the National (iovernors' Association, 
the Education Commission of the States, the Council of Chief 
State School Officers, and state legislative organizations. 

Nevertheless, a coordinating body is still needed to ensure the 
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establishment of national education standards and a system of 
assessments. This body would be a catalyst and provide 
oversight and leadership. The body would establish guidelines 
for standards-setting and assessment development and general 
criteria to determine the appropriateness of standards and 
assessments recommended. This body would be the National 
Education Standards and Assessments Council (NESAC). 

It is vital that there be strong public accountability in this 
work. For this reason, NESAC would be appointed by the Panel. 
Certification of content and student performance standards and 
criteria for assessments as world class shall be the joint 
responsibility of the Panel and NESAC. No certification will be 
issued by the Panel except after approval of NESAC and in the 
event the Panel denies certification to all or part of a NESAC 
proposal, all or part of that proposal shall be returned to NESAC 
with the reasons for denial. 

It is desirable that Congress and the President codify the 
reconstituted Goals Panel and the National Education Standards 
and Assessments Council, consistent with the Panel's charter 
and this coordinating structure, and appropriate line-item funds 
for their operation to be administered through the U.S. 
Department of Education. However, the Goals Panel and NESAC 
would be allowed substantial latitude in their operation and 
would be as independent of the U.S. Congress, the U.S. 
Department of Education, and other federal agencies as 
permissible under federal law. The Panel and NESAC will each 
be able to hire staff, enter into contracts, make grants, receive 
funds both private and public, form committees, hire 
consultants and have gift authority 

To the extent practicable, the characteristic of these (entities 
as voluntary partnerships committed to transforming American 
education by encouraging the Nation to strive for and achi(!ve 
the National Education Goals and World Class Standards would 
be maintained. 

Membership 

NESAC would consist of 21 members to include! or.e-third public 
officials, one-third educators, and one-third membtn s of the 
general public including consumers of education. The mcmibers 
would be appointed for thrt^e-year terms, with no individual 
sei-ving more than six consecutive years. Officers would be 
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elected for one-year terms. I Jo person can serve on both the 
Goals Panel and NESAC. 

Because NESAC will be making determinations and 
recommendations on the merit of standards and assessments, 
the appointment process must take potential conflict-of-interest 
considerations into careful account. 

Appointment Process 

Nominations for positions on NESAC would be sought from 
the general public and from these nominations the Panel would 
make appointments according to the established categories. The 
Panel would establish initial terms for individuals of two, three, 
or four years in order to establish a rotation in which one-third of 
the members are selected each year. 

As vacancies arise on NESAC, the Panel would seek 
nominations from the general public and t he Panel would make 
the appropriate appointments. 

National Standards and a System of Assessments 
as Parts of Comprehensive Educational Reform 

Structures and processes nt only have to be put in place to 
develop standards and assessments but are also needed to 
support their use by schools throughout the Nation. Sound 
programs of instruction must be tied to standards and 
assessments. The Council recognizes that states, local 
communities, and schools set important policies that establish 
the context in which standards and •< ^.essments will operate. 
These include policies and practices regarding curriculum, 
professional development, school restructuring, and community 
and family supports. Such reforms should not be piecemeal. To 
be most effective, they must operate in an integrated fashion. 

Comprehensive systemic reform should affect all elements of 
the education system. Families, educators, and policymakers 
nmst all work together. Their efforts at the schooi, district, state, 
and national levels should address four major dimensions of 
(educational renewal, reforming schools, engaging families and 
communities, creating incentives for high performance, and 
providing equitable opportunities to achieve the new standards. 
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Reforming Schools 

All children must have the opportunity to learn the material that 
new standards will indicate they should know. Improved 
instructional materials and instruction based on the standards 
are essential. Schools will need curriculum frameworks oriented 
to high levels of perfomiance that are based on the national 
education standards. 

New assessments should be designed to guide instruction and 
learning. What is expected should be clear enough that teachers 
can prepare students for the assessments and teachers should 
be able to use the results to revise and improve their teaching. 
Teachers must be active participants in the design of curricula 
and assessments tied to the standards. 

High standards of achievement for all students will have 
implications for how America prepares, licenses, and certifies its 
teachers. To teach successfully to the new standards, teachers 
will need a deeper knowledge of subject matter and a better 
understanding of pedagogy. Substantial cooperation from 
universities, especially colleges of arts and sciences, in teacher 
preparation will be required. The National Board for 
Professional Teaching Standards has embarked on an effort to 
set national, voluntaiy standards for experienced teachers that 
would promote quality instructional practices. 

A comprehensive inservice professional development 
initiative is also essential in preparing teachers to help students 
attain the national education standards. States have a critical 
role in helping to make the mofjt successful practices in 
professional development accessible to all personnel. 
Professional development must also be available to school and 
district administrators, who play key leadership roles in school 
reform. 

Schools, school districts, and stat(is should be encouraged to 
experiment with alternative strategies to help students achieves 
the new standards. New roles ai\d responsibilities are likely to be 
necessary for success. Reforms ihat seek to make educators 
accountable also need to provide them with commensurate 
authority. 

Education technology holds promise for helping students and 
schools achieve the standards and will be a basic requirement 
for education in the 21st century. Possibilities inc lude; distxince 
learning that permits greater access for teachers and students to 
courses offered in different locations, and computer and video 
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technologies for the delivery of enriched interactive learning. 
Teachers and principals in all schools will need professional 
development in educational technology. New technologies 
aligned to the standards and system of assessments may be 
included among the curriculum resources designed to achieve 
the standards. 

Engaging Families and Communiries 

The conditions of childhood are changing and some of the most 
significant changes have to do with characteristics of families. 
Helping families so that they may help students attain the high 
standards will require new strategies for coordinating the efforts 
of home and school. 

Communities create the context in which schools and families 
function. Concerned communities value learning and provide 
necessary support to families so that learning can thrive. An 
important community service that is also supported by state and 
federal government is to provide the early childhood programs 
that help prepare children for school. The National Education 
Goals set objectives relating to nuti'ition and health care, access 
to preschools, and parent education. Programs have begun at 
the national, state, and local levels to foster coordination of 
family health care and social services. 

National standards can clarify what a community can expect 
of its schools and help define a need for public action. Too 
frequently school reforms fall short of expectations because 
members of the public do not understand how they can play a 
constructive role in improving their schools. Efforts are needed 
to enhance local awareness of the need for change and to create 
shared understandings of educational problems and potential 
solutions. 

Creating Incentives for High Performance 

Meeting high standards will entail compi'ehensive change, and 
the students, families, educators, and communities involved will 
need to have a reason to change, (currently, incentives for 
students and educators are overly focuse i on (!ompliance with 
rules and regulations. They should be focused on attaining high 
performance. While intrinsic rewards such as love of learning are 
the best — and often primary — motivation, it is clear that 
external factors also play an important role in how hard both 
students and educators worl<. Rewards for success and 
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constructive intervention in cases of persistent failure may be 
tied to student outcomes for both students and educators. Since 
learning requires the active participation of both, it would be 
unfair to focus incentives only on one or the other. Today, 
students not applying to highly selective colleges often fail to see 
a reason to enroll in demanding high school courses and to do 
their best. All students should be provided incentives for 
meeting world-class standards. Incentives for educators should 
focus on improvement, including success in educating those 
students who have been least well served in the past. 

Ensuring Equity 

Providing genuine opportunity for all students tc achieve high 
standards is a national moral imperative. The standards that the 
Council proposes would apply to the entire education systera. 
All students must have the opportunity to achieve them and to 
be assessed fairly on their attainment. To bring this about, 
equitable educational opportunities must be provided. 

The Council recognizes the concerns of those who are fearful 
of the unintended consequences of its proposals. Yet high 
standards and knowledge gained from appropriate assessments 
could sei-ve as rallying points to secure the school and 
community efforts needed to reach them. High-quality 
standards and assessments should mobilize educators and the 
public to reform schools, engage families and communities, 
create incentives for high performance, and provide genuine 
opportunity for all students. 

Raising Standards for American Education 

The National Education Goals Panel has called upon America to 
become ^ nation of learners. National standards and 
assessments linked to them, developed through a broad 
consensus process, are a critical next step in revitalizing 
American education. To succeed, standards and assessments 
must be part of a fundamental reform of schools and school 
systems. 

The move toward high standards will require mobilizing the 
entire country. Families, communities, schools, educators, 
employers, policymakers, and students have important roles to 
play in the comprehensive effort to fashion new standards and to 
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see that they are attained. 

The goal is ambitious and the stakes are high. Raising 
standards can transform what, is taught and how instruction *- 
takes place. Raising standards can change tho view of 
responsibilities in education.Raising star, ^ards can improve the 
quality of performance, not just in the classroom but on the job, 
in the marketplace, and in all aspects of American life. 
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Authorization for the 
National Council on 
Education Standards 
and Testing 



Purpose 

The National Council on Education Staiuianis and Testing was 
created by Public Law 102-62 on Jur»e27, 1991. The purpose of the 
Council is to provide advice on the desirability and feasibility of 
national standards and testing in education. 

The Council was created ii\ response to findings of Congress that: 

• Organizations have begun developing national education standards 
foi' various subject areas and grade levels; 

• Groups have called for the expansion of imtional testing for school 
children; 

• Decisions regarding the desirabilit y and feasibility of additional 
national testing should follow such decisions on national standards 
for education; 

• Kfforts regarding national standards and testing should be 
undertaken with the broadest possible participation by the public; 
and 

• A major national council is needed to assure broad f)articipalion by 
the public, to provide a focus for national debate on national 
edu(.'ation standards and testing, and to provide advic(^ on the 
d(»sirability and feasibility of developing national standards and 
testing. 



Duties 



The duties of the Council shall be to advise the American people 
as to — 



1) Whether suitable specific education standards should and can be 
established, such as world class standards, for — 

(a) the knowlecge and skills that students should possess and 
that schools should impart in order that American students 
leave grades 4, 8 and 12 demonstrating competency in 
challenging subject matter including English, mathematics, 
science, history, and geography; and 

(b) every school in America to ensure that all students learn to 
use their minds well so that they will be prepared for 
responsible citizenship, further learning, and productive 
employment in our modern economy; and 

2) Whether, while respecting State and local control of education, an 
appropriate system of voluntary national tests or examinations 
should and can be established, such as American achievement 
tests, that will provide prompt, accurate infonnation to parents, 
educators, and policy makers on the progress being made toward 
the specific education standards by individual students, schools, 
school systems, States, and the Nation as a whole (if such 
standards can be established). The goal of any such system shall 
be to foster good teaching and learning, as well to monitor 
performance. 



Final Report 

The Council shall, as soon as possible, but not later than December 31, 
1991, submit a report to the Congress, the Secretary of Education, 
and the National Education Goals Panel that contains 
recommendations regarding long-term policies, structures, 
mechanisms, and other important considerations with respect to the 
objectives. A discussion of the validity, reliability, fairness, and costs 
of nplementing a system of voluntary national tests or examinations 
snail also be included in such report. 
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Appendix C 



Public Comment 



T 

Xhe National Council on Education Standards and Testing has 
sought public comment. The comm^Mits it has received have helped to 
shape this report. The Council wishes to thank the individuals and 
organizations listed below for their suggestions and observations. The 
Council recognizes that while some statements submitted to it 
represent official positio?\s taken by an organization, others w^re 
submitted as the views of an individual who does not claim to 
represent the ir.stitution with which he or she is affiliated. 

• State delegations attending the i>Jaiional Education Forum in Des 
Moines, Iowa, September 27-28, 1991 

• Advocates for Children of New Yorl ' ' , Diana Autin 

• AJliance for Curriculum Reform, Gordoi C'awelti 

• American Occupational Therapy Association, Barbara Chandler 

• American Psychological Association, Wayne Camara and Gerald 
Sroufe 

• APPLE Corps, Sallie Weddell 

• Arizona State University, Carole Edelsky 

• Arkansas, Office of the Governor, Deborah Walz 

• Association of American Publishers, Test Committee, Michael H. 
Kean 

• Association of Black Psychologists, Sandra (>ox and Harold Dent 

• Association of California School Administrators, Melinda Melendez 
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• Association for Supemsion and Curriculum Development position 
statements by the national organization, state affiliates, and 
individual members 

• Autism iSociety of American, David Holmes 

• Brain-Based Education Network, Leslie Hart 

• Brigham Young University, Utah, Rulon Garfield 

• Business Roundtable and National Alliance of Business, Fritz 
Edelstein 

• Campaign for Genuine Accountability in Education, Monty Neill 

• Canton City Schools, Ohio, Wayne Denny 

• Central Park East Secondary School, New York, Deborah Meier 

• College Board, Donald Stewart 

• Consortium for Citizens with Disabilities 

• Council for Exceptional Children, Joseph Ballard and Mary Cohen 

• District of Cohimbia, Janetle Hoston Harris 

• Easton Public Schools, Massachusetts, Isa Kaft^U Zimmerman 

• Elmbrook School District, Wisconsin, Ronald Lange 

• Foxfire Teacher Outreach, Hilton Smith 

• Ilima Intermediate School, Hawaii, Amy IJyechi 

• hidiana University, Leonard C. Burrello 

• Kamehameha Elrmentary School, Hawaii, Kahele Kukea 

• Mariemont City Schools, Ohio, Donald Thompson 

• Mexican American Legal Defense Fund, Steph(Ui (^arbo 

• Midland Public School, Michigan, Carol Feider 

• Mississippi Bend Area Education Agency, Richard Hanzelka 

• National Alliance of Business 

• NAACP Legal Defense and Echication Fund, Julius (Chambers 

• National Center on Education Outcomes 

• National Coalition of Education Activists, Debi Duke 

• National Conference of State Legislatures, Education and Job 
Training Committee 

• National Council for the^ Social Studies, Charlotte Anderson 

• New York City Board of Ed. (District 1), Susan Harman 

• Norfolk Public Schools, Virginia, George Raiss 

• North Carolina, Office of the Governor, Jackie Womble Jenkins 

• Northwest Association of Schools and Colleges, David Steadman 

• Panasonic Foundation, Sophie Sa 

• Parkway School District, Missouri, William Franzen 

• Peiuisylvania Department of Education, Joseph Bard 

• PorUige (bounty Board of Education, Ohio, Helen Gless 

• Punahou School, Hawaii, Duane Yee and Elaine Blitman 

• Southern Association on Children Under Six, Cathy Grace 

• Southern Regional Cvouncil, Marcia Klenbort 
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• Student Advocacy Center, Ruth Zweifler 

• Teachers and Parents for School Renewal, Oregon, Bill Resnick 

• University of California, San Diego, Tracy Strong 

• Urban Superintendents' Network (Office of Educational Research 
and hnprovement, U.S. Department of Education) 

The Council also thanks the following organizations for tfieir help in 
requesting public comment; 

• Association for Supervision and Curriculum Development 

• Business Roundtable 

• P^airtest 

• National Alliance of Business 

• National Association of State Boards of Education 

• National Conference of State Legislatures 

• National Governors' Association 

• National Association of School Boards 



ERJC 



Appendix D 



The National 
Education Goals 



Goal 1 : Readiness For School 

By the year 2000, all children in America will start school ready 
to learn. 

Objectives: 

• All disadvantaged and disabled cWldren will have access to high 
quality and developmentally appropriate preschool programs that 
help prepare children for school. 

• Every parent in America will be a child's first teacher and devote 
time each day helping his or her preschool child learn; parents wiW 
have access to the training and support they need. 

• Children will receive the nutrition and health care needed to arrive 
at school with healthy minds and bodies, and the number of low 
birthweight babies will be significantly reduced through enhanced 
prenatal health systems. 



Goal 2: High School Completion 

By the year 2000, the high school graduarion rote will increase 
to at least 90 percent 

Objectives: 

• The nation must dramatically reduce its dropout rate, aiul seventy- 
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five percent of those stucieiits who do drop out will successfully 
complete a high school degree or its equivalent. 
• The gap in high school graduation rates between Americ:an st udc^nl s 
from minority backgrounds and their non-minority coir^terparts will 
be eliminated. 



Goal 3: Student Achievement and Citizenship 

By the year 2000, American students will leave grades four, 
eight, and twelve having demonstrated competenqr in 
challenging subject matter including English, mathematics, 
science, history, and geography; and everyr school in America 
will ensure that all students learn to use their minds well, so they 
may be prepared for responsible citizenship, further learning, 
ana productive employment in our modem economy. 
Objectives: 

• The academic performance of elementary and secondary stud(Mas 
will increase significantly in every quartile, and the distribution of 
minority students in eacii level will more closely reflect the student 
population as a whole. 

• The percentage of students who demonstrate the ability to n^ason, 
solve problc^ms, apply knowledge, and write and communicate 
effectively will increase substantially. 

• All students will be involv(?d in activities that promote and 
demonstrate good citizenship, conmmnity service, and personal 
resi)onsibility. 

• The i)ercentage of students who an> competent in morv than onv 
language* will substantially incn^ase. 

• All students will be knowledgeable about the diverse^ cultural 
heritage of this nation and about the world conununity. 



Goal 4: Science and Mathematics 

By the year 2000, U.S. students will be first in the world in 
science and mathematics achievement 

Objectives: 

• Math and scic^nce (niucation will b(> strfMigtluMied througlioiit the 
.system, especially in the* early grades. 

• The number of teachiM's with a substantive* background in 
mathematics and science will increase by r>tJ percent, 

• The number of U.S. undergraduate^ and graduate studcMits, 
especially wonuMi and min()nti(\s, who compU^te^ dc^grtn^s in 
mathematics, science, and engineering will incre»ase significantly. 
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Goal 5: Adult Literac/ and Lifelong Learning 



By the year 2000, every adult American will be literate and will 
possess the knowledge and skills necessary to compete in a 
global economy and exercise the rights and responsibilities of 
citizenship. 

Objectives: 

• Eveiy major American business will be involved in strengthening the 
connection between education and work. 

• All workers will have the opportunity to accjuire tlic knowledge and 
skills, from basic to highly technical, needed to adapt to emerging 
new technologies, work methods, and markets through public and 
private educational, vocational, technical, workplace, or other 
programs. 

• The number of lugh-ciuality programs, including those at libraries, 
that are desigiuni to seiTe more effectively the needs of the growing 
number of part-time and mid-career students will increase 
substantially. 

• The proportion of those qualified students (especially minorities) 
wlio enter colk^ge, who complete at least two years, and who 
compk^te their degree programs will increase substantially. 

• Tm' proportion of college graduates who demonstrate an advan(!ed 
ability to think critically, communicate effectively, and solve 
problems will increase substantially. 

Goal 6: Safe^ Disciplined and Drug-free Schools 

By the year 2000, every school in America will be free of drugs 
and violence and v/ill offer a disciplined environment conducive 
to learning. 

Objectives: 

• Eveiy school will implement a firm and fair policy on use, 
possession, and distribution of drugs and alcohol. 

• Parents, busin(\sses, and conuminity organizations will work 
together to ensure that schools are a safe haven for all children. 

• Eveiy school district will develop a compreluMisive K-12 drug and 
alcohol prevention f»ducation program. Drug and alcohol curriculum 
should be tauglit as an integral part of health (niucation. In adtiition, 
community-based teams should be organized to provide students 
and teachers with needed support. 

Th(^ National [Education (loals Panel was formed to report aimually on 
tlie progress of the Nation and the states toward achieving thc^ 
National P^ducation (loals. Its first chair was Governor Roy Homer of 
(yolorado, who was succeeded in August 1991 by (iovernor Carroll 
(>ampbell of South Carolina. The Goals Panel was originally composed 
of six govcM-nors, three Democrats and three Hepublicans; four 
meiubeM's of the President s Administration; and four ex officio 
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members, the majority and minority leaders of the U,S. Senate and the 
U.S, House of Representatives. Its first report, the National 
Education Goals Report: Building a Nation of Learners, was 
issued September 30, 1991. 
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Appendix E 



Report of the 
Standards Task Force' 



Introduction 

This report responds to issues pertaining to the desirability and 
feasibility of national education standards posed in the legislative and 
supporting language of HR 2435, the enabling legislation for the 
National Council on Eduriation Standards and Testing, The report 
specifically addresses questions raised in House Committee Report 
102-104, which accompanies the enabling legislation. This 
introductory section of the report reviews the pertinent legislation 
and supporting langi age concerning the desirability and feasibility of 
national education standards, provides a brief description of the three 
other parts of the report, and highlights three important underlying 
assumptions of our work. 



L Adrr.ft of this report was pn'panMi for the consiticration of the National ^'oimcil on 
Kdui.-atioii Standards and Testing? at their Orlnher, November, and Deceruher, 11)91 rne( tin>^s. 
The report was prepared hy Marshall S. Smith, aided by Susan Fiihrnian and Jennifer O'Day. 
The content of the report is base(i lar>?ely on two otie day meetings of t}u> Standards Task 
VorcA) of the National ('ouncil on Kdncatioti Standards and Testing held on September 19 and 
October 20. The report draws on a j)relinunary paper of the Task Force pr^'pared for the 
September 23 meotin^^ of the f'oiineil, a summar>' of the report i)repared for discussion 
purposes fortlie October lil meetiti^ of the Council, and discussions of the ('ouncil, 
particularly at the S(»ptember and October meetiriMs. Insofar as possible this report 
represents aconsonsus of the Task Force bjji a consensus was not possible in all instances. 

The views expressed in this appendix report rejlect the work of 
this Task Force and are not necessarily those of the Council 
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Legislative and Supporring Language 

Sea 4 Duties of the National Council on Education Standards and 
Testing Act (HR 2435) states: "The Council shall advise the American 
people on whether suitable specific education standards can be 
established such as world-class standards, for — 

• the knowledge and skills that students should possess and tliat 
schools should impart in order that American students leave grades 
4, 8, and 12 demonstrating competency in challenging subject 
matter including English, mathematics, science, history, and 
geography; and 

• every school in America to ensure that all students learn to use their 
minds well so that they will be prepared for responsible citizenship, 
further learning, and productive employment in our modern 
economy; and..." 

The House Report elaborates on Sec 2 of the Bill with very specific 
language: 

[The Council shall] "... provide advice on (l)whether suitable 
.specific education standards should and cnn be established, and..." 

"It is the intent of the Committee that the ancil address each of 
these issues in terms of its desirability and feasibility consistent 
with the biirs stated purpose (see section 2 (a) of the bill)." 
•"...the Committee in no way endorses the proposition that national 
education standards... are either desirable or feasible. It is the 
purpose of the Council to examine a broad range of considerations 
with regard to these two issues and report their findings and 
recommendations to the Congress, the Secretary of Education and 
the National Goals Panel..." 

Structure of the Report 

This report responds directly to th(? issues concerning the desirability 
and feasibility of national education standards sd out in HR 2435 and 
in the House Report. The report has three remaining parts: 

• Part II proposes a definition of echication standards which pays 
attention to the conceptualization of education standards set out in 
section 4 of the Bill. 

• Part III considers the desirability of this Nation having "national 
education standards." This discussion responds to the questions set 
out in the House report on the Rill. 

• Part IV considers whether it is feasible for this Nation to have 
national education standards. This discussion also responds ^.o the 
House Bill report. 

Three Underlying Assumptions 

Before considering the definitions w(^ want to underscore^ three 
important assumptions made in this report. 
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• National vs. Federal Standards, We assume from the language of 
the Bill and the Report and from early discussions of the Council 
that Congressional intent is that the education standards are to be 
national rather than federal. We support this interpretation. We take 
it to mean that, while the process for establishing and implementing 
the standards should be national in scope, it should not be under the 
control of the federal government, though the various parts of the 
federal government (the Congress and the administration) should 
be important participants. It also implies that the process for 
establishing the standards should reach out across the Nation to the 
n\any states and their communities. 

• Voluntary vs. Mandator/j (Imposed) Standards, If standards are 
national rather than federal, we assume that they are "voluntaiy" for 
the states. We support this interpretation. Only the federal 
government could have the authority to require states to use 
national education standards — and even that is unlikely in light of 
the language of the Constitution. Discretion for the adoption of the 
standards would continue to rest with the states, providing an 
important balance of power and responsibility. This is an extremely 
important point. It addresses the question in the House Committee 
Report which asks "what the benefits and liabiliti(»s are of imposing 
uniform national standards... on an education system where* 
curriculum is traditionally controlled at the state and local level." 
The position taken here is that "education standards" would b(^ 
voluntary, not mandatoiy or imposed nationally. The issue about the 
desirability of voluntary national standards, uniform or not, is 
naturally still iniportant and will be fully consid(*red. We remind the 
reader that being voluntaiy nationally would not stop iiulividual 
states from making the standards mandatoiy for the school districts 
within their borders. 

•Chathnfjiruj, voi winiirml education standards, Undergirdiiig 
the interest in national education standards is the idea that the 
content of the present curriculum in most United States schools 
lacks coherence, depth, and quality. Throiighout this report we 
assume that national education standards will legitimately be "world 
class" in scope and quality. They must reflect high, not minimal, 
expectations for all :)f mv Nation's students. If they are not 
challenging and of the highest quality, they are guaranteed to do 
more harm than good. 



Definition of Education Standards 

Education standards should respond to the fundamental questions: 
What should sciiools teach? What should students learn and how well 
should they learn And, in response to the text of the enabling 
legislation: What is the quality of a school's capacity to "ensiire that all 
students learn to use their minds well...?'' The term education 
standards is generic— it is iniportant to develop a set of specific 
definitions for use by the Council and for responding to the important 
questions posed in the legislation and in the legislative report. The 
work of the National Council on Education Standards and Testing on 

January 2^, 1992 K^i 

ERIC ^^ 



education standards has focused primarily on five subject matter 
areas; English, mathematics, science, history, and geography. Within 
the context of a defined subject matter area we can distinguish 
several specific components designed to fiesh out an overall definition 
of education standards.^ 

Overarching statement 

The overarching statement should describe in brief and general 
terms a vision of the nature of the education standards for the content 
area. It should emphasize a theoretically and pedagogically coherent 
and engaging presentation of challenging, up -to-date subject matter 
and high expectations for achievement by all students, including an 
ultimate goal of world-class student achievement. The description of 
"Mathematical Power" in the new California Mathematics Framework 
is an example. 

Content Standards 

Content standards should set out the knowledge, skills, and other 
necessary understandings that schools should teac:h in order for all 
American students to attain iiigh levels of competency in tiie subject 
matter. Generally, and for our purposes, what schools are expected to 
teach is equivalent to the knowledge, skills and other understandings 
that students are expected to learn in schools.'^ The National Council 
of Teachers of Mathematics (NCTM) Curriculum and Evaluation 
Standards for School Mathematics, the California Frameworks, the 
Syllabuses for the Advanced Placement Tests of the College Board, 
and the Course of Study for Lower Secondarii Schools in Japan are 
all examples ol content standards. For the purposes of the work of 
the Council, content standards should cover the entire range of pre- 
collegiate formal schooling (grades K-12) as do the NCTM 
Curnculuvi ami Evaluation Standardsfor School Mathematics 
and the ('alifornia F'rameworks. 

Student Performance Standards 

student perjarmance standards should establish the degree or 
quality of student performance in the challenging subject matter set 
out in the content standards. In general, the; developnuMit of such 
standards will require examples of a range of professionally judged 
studeia performances which serve as benchmarks tor assessing the 
quality of a new student's performance. For example, the College 
Roard Advanced Placement (AP) Tests are scored one (1) through 
five (5). Typically, a score of three (:^) indicates that a student has 
performed well enough to pass a college level examinatioi\ on the 



:i The Hvc siihjrd niiUKM' an*ns arc explicit ly included in the loMi^^liiti"" ^"i^t in tlu' rrporl (}f 
the National Hrlur atuui iUnxh Paiu*l. 

:i Some authors and slates use ihe \or\\] "furricnliwu IVanu'Work" instead of (Ik tei 'i "cfuitent 
standards." For our pnr[)oses we Uikv the two terms to have itjent ieal rneaninM- Soinetinu»s 
the term ''achievt^menl standards" is useci to specify the content sliitlcnts arv cxpec(e(i to 
l(»arn while the term ^'eonteet statidards" is nsed to specify the fonunit th.at scliools are 
experted tf) teach, lien* we are assnniiiiM tlii^t tl»t' two botlies of content are i-quivaleiit and 
thus we use the term ontent stamiards" ttj lefer to both what student are expected to learn 
and what schools are exp(»eted to teacli. 
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subject, a score of four (4) indicates the student would have gotten a 
B in a college course examination, and a score of five (5) is sui)erior 
performance equating to an A in college. The assignment of a level of 
performance on an AP Test requires an explicit comparison of the 
examination performance (essays, analyses of text, record of how 
difficult calculus problems are solved) with the prior performance of 
successful and unsuccessful college students on "equivalent" tests. 
The Task Force recommends that at least a three level scale of 
student performance standards will be necessary for grading 
assessments based on the education content standards. These might 
be labeled "competent performance," "excellent performance," and 
"world-class performance" standards. In order to establish the criteria 
for the final level, "world-class standards," we will need to gather 
information about the quality of the best student work in other 
nations. 

School Delivery Standards 

School delivery standards should set out criteria to enable local and 
state educators and policymakers, parents, and the public to assess 
the quality of a school's rapacity and performance in educating their 
students in the challenging subject matter set out by tlie content 
standards. School delivery standards should provide a metric for 
determining whether a school "delivers" to students the "opportunity 
to learn" well the material in the content standards. Are the teachers 
in the school trained to teach the content of the standards? Does the 
school have appropriate and high quality instructional materials which 
reflect the content standards! Does the actual curriculum of the 
school cover the material of the content standards in sufficient depth 
for the students to master it to a high standard of performance? These 
input conditions are fundamental to providing all children the 
opportunity to learn the material of the content standards. Finally, 
on the outcome side, does the performance of the students in the 
school indicate that the school is successfully providing the 
"opportunity to learn" to all students? The concept of school deiuu^ry 
standards was developed by the Task Force to respond directly to 
the language of Sec. 4(1)(B) of HR 2435 which calls for "world-class 
standards for... every school in America to ensure that all students 
learn to use their minds well..." (see the Legislative and Supporting 
Language section of this report for more detail). 

System Delivery Standards 

System delivery standards should set out criteria for establishing 
the quality of a school system's (local, slate, or national) capacity and 
performance in educating all students in the suhjec^t matter set out in 
the content stayidards. To some degree the system delivery 
standards for the Nation have already been developed by the 
National Education Goals Panel and the President in Goals 3 and 4, 
which establish targets for student achievement for the year 2000. 
The Task Force recommends that each state and local district 
establish their own achievement targets which, when summed, would 
enable the Nation to reach the National Goals. 
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Desirability of National "education Standards 

The questions set out in the House Report focus on the issues of the 
desirability and feasibility of national education standards, hi this 
section we focus on the series of questions which address the issue of 
the desirability of national standards/^ For background and the 
consideration of the Council, however, we first briefly summarize 
some of the typical arguments for and against establishing national 
standards. 

By and large these arguments are captured by three overarching 
questions: 

14^7// iiatioiial standards hare a posit irr ifijhumcr on studetit 
achievement and the qualitij of teachers and schools/ 

What is the potential impact of national standards ofi 
educational e(fu itfj,^ 

Are national standards appropriate giren the Ann^rican 
tradition of local control of cnrnculunt and the existing ivide 
variations in state and local resources for education/ 

These three overarching questions also provide a structure within 
which to address the Congressional questions set out in the House 
Report on HR 2435. After summarizing the "typical" pro and con 
arguments we turn to a more complete consideration of the three 
overarching questions. 

Typical Arguments For and Against National Education 
Standards 

Arguments Used to Support National Standards 

• The international standing of the 1 Inited States and the 
competitiveness of the Ihiited States economy, system of security, 
and diplomatic influence an^ national, not state or local. They 
re(iuire national attention to the development of the nation's human 
capital. 

• National (education standards will help assurt^ that our increasingly 
(livers(» and mobile population will have the shared knowledge and 
values necessary to mak(^ our democ^racy work. 

• National standards will helj) improve the (luality of schools and of 
teacher professional development by providing a clear, common set 
of challenging goals and criteria for the allocation of scarce 
resources. 

• National standards applical)le for all children will helj) i)rovi(le the 
imiietus for realizing equality of educational opportunity across the 
Nation. 



4. This sccnmi also juhlrrsscs t In* (iiicstions srl oiil in thr SrptiMnlwr 1^0. 1 IrWrr tn thr 
Couiu'il from Coii^tn.ssmcii (HMulliiin and KihlctNtiid from Senator Hatch uliu h csscntuilly 
rciM-ats th(' questions in the H()us(» Coninullcp Report, though in a dillVnMit (»nler. 
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• The ostablishrtuMit of chalhMi^iit^; natioiml staiulards will encourage 
states ami localities to raise their educational expectations and 
standards. 

• The states have scai'ce resources of t alent and funds for the task of 
establishing tlieir own standards and assessment systems. It would 
be far more efficient foi* the several stales and localities to cooperate 
in a national approach than to create their own standards and 
assessment systems separately. 

Common Arguments Against National Standards 

• Our Nation's experience with centrally established slcindards (e.g., 
at tlio state level in education and at the state and national levels in 
other se^ctors) is that they are generally "ininimuiu standards'' which 
act to drag down the entire system. If such happened with national 
education standards, the entire system would suffer. 

• If challenging national standards are established, but the strategic^s 
and resources for enabling students and schools to meet ihem are 
not i)Ut into place, the result will be a disservice to the Nation's 
students. 

• The establishment of national standards would draw attention and 
resources away from the many, veiy positive state and local refoi'ms 
that are now underway throughout the Nation. 

• Nati()i\al standards will h^ad to a national curriculum, which will 
inhibit local and state creativity and initiative. 

•The great diversity of the Nation, culturally and ethnically, and in 
regional traditions, make it impossible to have a single common set 
of education standards that would hav(^ widespread acceptance. 

Will NaHonal Standards Have a PosiHve Influence on Student 
Achievement and the Quality of Teachers and Schools? 

This a(l(iress(\s qu(\sti{)n li in the House ('onunittee R(^port. [Is ther(^) 
"any evidence that national (uiucation standards... pr()nK)i(^ 
improvements in educational achievement or in th(^ al)ility of teacliers 
to perform their jol)s:" In order to answ(T this (lUesticHi it is important 
to consider l)oth the current condition of schooling in American and a 
future condition where then* an^ "voluntaiy national standards". 

What is the Current Situation? 

• No r.vpUrif uatioudl cdncatiou content or pcrfornnnu'C 
standords runvntli/ r.rist. In the past, this Nation and its states 
have typically not (established or required eitlier cliallenging content 
st(nidards or absolute standards of high student p(M*formanc(\ 
Instc^ad of setting challenging content expectations, instead of 
({(^termining wluit lev( 1 of performance r(M>resents a high level of 
masteiy of contcMit, we have replied on n^lativc^ comparisons nmong 
schools, districts and states to give us an indication of how well we 
are doing, Our standardized tests geruM'ally tell us wh(Mh(M* our 
students are above oi* below the average in the Nation or in the state, 
not wheth(M* their pt^rformance is sup(Tior either wh(Mi compared to 
an international standard or to some a priori absolute^ standard. 
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We now have a de facto national curriculum of basic skills. In 
the absence of common, well specified, demanding content 
standards and high expectations for students our Nation has 
gravitated toward ade facto national minimum competency 
curriculum. P]xcopt for the small percentage of our Nation's students 
who are headed for elite four year colleges, the Nation's content 
standards focus on basic reading and arithmetic skills, and 
relatively minimal amounts of factual information in science, 
geography and history. 

This focus on basic skills reflects both intentional policy at state 
and local levels and the indirect influence of otfier forces — 
including textbook publishers who cater to the lowest common 
denominator in conteiU, test developers and educatioiml 
administrators who use standardized tests which reinforce this 
focus, and teachers who have had neither adequate training nor 
appropriate role models in their own educational experience. In 
addition, some evidence indicate? that teachers tend to focus their 
teaching on maximizing student performance on tests used for 
accountability purposes, which have typically emphasized basic 
competencies. 

• Public expectations for student performance are also sadly low. 
As parents, as voters, and as members of the general public we settle 
for far less than do our counterparts in other developed Nations. 
Most state standards, where they exist, provide a floor, not a goal, 
for practice. High, or leading edge, requirements for education 
practice and student performance luv.m that for some period of 
time, and perhaps a lengthy period, most schools would be below 
standard, a situation typically viewed as politically intolerable. When 
high standards are proposed they are likely to also be followed by 
educator requests for more resoun^es, making policymakers waiy of 
initiating the cycle. This condition is beginning to change in a few 
states such as South Carolina and Vermont but the general fact is 
that, in a tight econoitiy, the battle in states for higher education 
standards is very difficult to win. Typically, the voters are only 
lukewarm, and this makes the policymakers legitimately cautious. 

• The qualitfi of our schools too often reflects our minimal 
expectations. With the general e xception of schools in affluent 
areas, many of our Nation's youth attend institutions that lack the 
human and material resource's necessary to deliver to students a 
curriculum based on a challenging conception of content. In too 
itiany schools there is no science lab, students an^ not allowed to 
take honu^ textbooks or other books to do tlieir homewo: k, and, of 
most concern, teachers are not trained well enough to understand, 
much less to teat:h, thc^ kind of demanding material envisioned in the 
nenv content standards. 

• In suwnniry, u^hile they meet nnr expertatioihs, (it the presefit 
time ()}(rro)itent, perfonmnuw and school delivery standards 
are mediocre at best. 
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What Effect Does the Low Quality of Our Standards and Our 
Schools Have on Student Achievement? 

It is difficult to imagine that our level of student achievement will 
improve greatly if we continue to support and implement our current 
minimal standards curriculum. Over the past 20 years student 
achievement has remained relatively flat or very slightly improved at 
best, wth the exception that minority groups, particularly African 
Americans, have improved in basic skills areas. This indicates that the 
emphasis in the 1970s and early 1980s on de facto basic skills national 
standards — spurred and reinforced by direct state and local policy 
activity — had a distinct and positive effect on student achievement 
for those who could most benefit from it. Our overall level of student 
achievement, however, remains low-to-mediocre when compared with 
that of other developed nations, and by some indicators our relative 
position is even declining. If we are satisfied with this continuing level 
of mediocre achievement we can continue to ignore the challenge of 
setting higher and more challenging standards, for the content of 
instruction, for student performance, and for school quality. Unless 
we make a conscious effort to do so, however, we will continue to be 
the slaves of a de facto nationally accepted conception of scliolastic 
achievement which is distinctly inferior to that of much of the rest of 
the developed world. 

What Might Happen to Student Achievement and Teacher 
Behavior if There Were Challenging^ Voluntary , National 
Education Standards? 

• VoluNtarij, cfiallencjiNfi natiomd cordeitt and prrfornniucc 
standards could stimulate improvements in state and local 
content and perfomuince standards and expectations. This, in 
turn, could have a positive effect on education practice in local 
schools and classrooms. The ('oiincil has heard testimony from the 
NCTM that t[ie content and teaching standanis that they have 
developed have had a great influence on the policies .ui practices of 
state and local boards of education as these groups have established 
the curricula of their jurisdictions. Similarly, though to a lesser 
extent, we understand that there is evidence that state and local 
comnumities liave drawn from the work of th(^ American Association 
for the Advancement of Science (AAAS) Project 206 1 for the 
development of national education standards for science. 

• But, content and performance standards alone cannot cluunje 
student achievement and teacher performance. Student 
achu^vement and teacher perfornuince will not be greatly innuenccnl 
by content and performance standards unless the standards are part 
of a coherent and systemic appnmch to improving instruction in th(^ 
schools. p]ducation policy efforts aimed at changing the status cpto 
are generally shoi i-lerm, uitconnt^cted to other policies and overall 
goals of the system, limited to a small set of schools or grades, and 
focused on particular problem areas rather than on the entire 
system. As a consequtnice they rarely have a sustaining (effect. 
National standards, however, could lay the foundation for a different 
approach. 
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• Challenging national standards coiild set expectations for all 
schools and grades in key content areas, signalling the type of 
substantive changes we need system-wide in all of our schools 
and classrooms. 

• A national examination system based on the conUnU standards 
could reinforce and assess attainment of the standards, (See the 
companion report from the Assessment Task Force,) 

• The covlev: and perfonmin-ce standards could form the basis 
for other state policies, such as those dealing with adoi)tion of 
instructional materials and te^acher licensing and professional 
development. We would then have se^veral interconnected policy 
efforts giving coherent guidance about teaching and learning 
around ambitious, not basic skills, outcomes. (See tlie 
companion report from the Implementation Task Force,) 

• Most important, student acliiavement and teacher pefforwancr 
ayill oydjj change in a dramatic waij if existing andfature 
teachers are trained to be able to teach the challenging contod 
in the new national standards. Though it would V)e iini)ortant that 
new instructional materials based on the new standards be 
developed and tliat schools have the other malcMial resources 
necessary to teach the content standards, none of this will help 
unless there is a dramatic effort to prei)are teachers to teach the 
new content. Most public school teachers do not have th(^ dee[), 
sophisticated understanding of subject matter required to teach the 
content indicated by the kind of education standards proi)()sed here. 
The new content expec:tations would also call for new ways of 
teaching, for strategi(\s that activc^ly engage students. Most teachers 
are not used to teaching in such ways. They havc^ few opportunities 
and little time to learn on the job. Nor does i)re-servic(^ professional 
development meet these challengers. If national standards are to 
spur improved teaching and learning, they will nwd reinforcement 
by extensive and carefully developed professional development 
activities, 

• Eeidence about the effect qfandntions, coherent instructional 
reforms on leaching anxl student achievement is positive ind not 
plentiful. Some states, notably ('alifornia, New York, VermonI, 
Kentucky, Ari/.ona and Arkansas, are aligning challenging content 
objectives and assessment, How^ever, almost all of these efforts an^ 
vvxy recent; most do not yet tie teacrher [)rofessional devc^lopment 
and instructional materials policies to the cm'riculum/assessineiU 
,strategies. This is a veiy different situation tlian exists i \ many othcM' 
develoi^ed nations whcM'c there ai'e coherent policy sysl (mus linking 
content standards to instructional materials, examination systems 
and professional deve^lopment. That there are currently few 
colierent systems designed to upgrade instruction in the Amerittan 
slates is a major reason for the Councirs (existence. 

The little direct evidence that does (>xist suggests that ambitious 
content standards rcnnforcc^d by assessment and othc^r policies have 
the potential to improve schooling, Preliminaiy data iiu^icate that 
the Califoi'ua mathematics framework actively influei , loc:al 
policy and instruction. A study using the International Kducation 
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Assessment's Seconti International Mathematics Study (SIMS) found 
that teach(TS in nations with more coherent curricular guidance were 
more consistent, mow alike in the topics they covered, indicating? an 
influence of the common focus. Analyses of national sui'vey data 
indicate tliat secondary schools in this Nation which have coherent 
approaches, such as common curricula and shared goals, tend to be 
somewhat more successful than other schools in limiting absenteeism 
and dropping out, improving achievenK.'nt performance, and reducing 
performance differences among students. 
• In summw% urill the adoption of new, e.rpliritlij rliallemjifuj 
education standards affect studefit achievemevt/ F^erhaps not 
directly, but the odds of our Nation's expectations and commitment 
changing without committing ourselves to challenging standards are 
practically zero. Moreover, as our experi(Mice in the 1970s and early 
1980s with minimum competencies indicat(\s, a common set of 
expectations and standards can affed teacher behavior and student 
achievement outcomes. This suggests th(^ possil)ility that more 
challenging content, performance, and deliveiy standards which 
were implicitly or explicitly adoptcnl by the Nation, in concert with 
serious systemic reform efforts, would have a positive effect for all 
students. 

Educarional Equity for Students 

This section addressees question 7 in tfie Hous(^ Rei)ort: "Whdher 
support that would i)rovide educationally disadvaiitagcul childnMi, 
handicapperi children, and children with limited Knglish proficiency 
tlie opportunity to succecui should be a part of any effort to implement 
ivational edu(*ation standards...? 

It is trite but important to say that a major part of th(\justification 
for national education standards must r(\st on lUvw promise for 
improving the quality of the educational experiences of the m(>st 
reedy in our socic^ty. 

Where Does the Nation Stand? 

During the 1970s and throughout the 198()s, th(^ acliievenuMit gap 
between majority and minority and rich and poor iuis been closing. 
(Jains made in the past twenty-five years l)y African Amc^rican, 
Hispanic American, and lowin(H)me (^hihiren in partially closing th(^ 
achievement gap with middle income whites have bwn due both to 
changes in social and economic conditions and to a national focus or) 
basic skills whic^h sought to equalize th(^ (juality of education offered 
to students of different backgrounds. The scor^vs of minorities and low 
inconu^ students have risen while the scores of the middle income and 
majority students have stayed essentially level. 

Over the past rjecade the social, political and economic 
circumstances of niany low in( ome and minority familic^s h'dw 
worsened. Moreover, the basic, skills emphasis in schools is being 
l(»gitin\ately cnticiz(ul for its failure to develop in all students the 
higher kwels of learning and more complex skills necessary in a 
technologi(*ally advanced society. As a cons(Hiuence» many local 
districts and schools have instituteni reforms that att(Mnpt to 
emphasize higher order thinking and a more challenging curriculum. 

4 O 
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Locally Initiated R^orms Might Widen the Gap 

As educationally proMressivo as the local reforms to improve the 
quality of the curriculum may be, they could also place many 
minorities and the pooi* at a new disadvantage because the poor and 
minorities in the society are typically the last to benefit from locally 
generated reforms — if they benefit at all. Districts and schools with 
large numbers of poor and minority students often have less 
discretionary money to stimulate reform, less well trained teachers, 
aiul more day-to-day problems that drain administrative energy away 
from constructive reforms. \i\ conjunction with the increasing 
nimibers of children in poverty and the depressingly bad economic 
condition of many cities the new reforms could well lead to substantial 
new increases in the achievement gap.^' 

This outcome will almost certainly occur if the clmnges in the 
schools are initiated one school and owv district at a time. If, however, 
the changes were expecied to apply roughly equally across the 
schools within a very large district or across the schools and districts 
within a state, there is some hope that greater eciuality of opportunity 
would result. 

Common^ Challenging Standards and High Expectations 
Could Serve Equity Well 

The opportutiity for a condition of equal rxp(H;tations could be? 
(Uihanced under a system (large district, stat(^ or Nation) which Irad a 
common set of challenging content staudards and high perjonnance 
standards for all of its students. Within such a system the nature of 
ino(iualities in resources necessaiy for preparing studei^^s to reach the 
common standards would be more easily expos(\i than under the 
present system where the expcH^tations differ across schools and 
districts. Differenms in the capacity (knowledge, experience) of 
teachers to teach i iie common material and in the (]uality of textbooks 
and school resources to support teaching the common material would 
be more likely to be evident. 

School Delivery Standards Are Critical 

Nonetlieless, if not accoitipanied by measures to ensure cnjual 
opportunity to learn, national content and performance standards 
could help widen the achi(^vement gap between the advantaged and 
the disadvantaged in our society. If national content and 
perfonnance standards and assessment are not accompanied by 
clear school d(^liver>' standards and policy measures designed [o 
afford all students an ecjual opportunity to h^arn, the concerns about 
diminishc^d ecjuity could easily be realiztnl. Standards and assessments 
must be accoinpanicnl by policies that provide access for all students 
to high quality resources, including appropriate instructional 
materials and well-prepared tc^achers. High conte)it and pofonnance 
standards can be used to challenge all students with the same 
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expectations, bill high expectations will only result in common high 
performance if all schools provide high quality instruction designed to 
meet the expectations.^ 

Federal Programs Can Help 

Federal programs for the needy could offer critical assistance for 
helping needy students meet high perjbrinance standards. For 
twenty-five years, equal opportunity in this Nation has meant 
something other than evenhanded treatment. Equal opportunity 
means extra attention, resources and assistance for those with special 
problems and needs. Through Chapter 1 (originally Title 1) of the 
Elementary and Secondary Education Act (ESEA); Public Law 94- 
142; and Title VII of the ESEA, the federal government has shown its 
commitment to provide special support for economically 
disadvantaged, handicapped, and limited English speaking students. 
Many states have parallel programs. 

Nothing about national standards suggests eliminating or reducing 
these programs. In fact, given the renewed importance of opportunity 
to learn in the context of consensus about what we want students to 
learn, these programs should take on additional importance. Students 
with special problems will continue to need extra help if they are to 
have equal opportunity. It will be veiy important, however, to 
consider the form of the assistance offered through the federal 
categorical programs. In the past these {)rograms have often been 
designed to operate mdependently of the central curriculum and 
instructional program of the schools. In the future, under a system of 
challenging conteyit and performunce standards, the federal 
categorical programs must be designed and implemented in a way 
that remforces the opportunities for the most needy students to 
perform to the highest possible level on the common conUntt 
standards. 

Diversity in States and Local Districts 

This section addresses questions 2 and 5 in the House report. "What 
the benefits and liabilities are of imposing uniform national 
standards ... on an educational system wher(^ curriculum is 
traditionally controlled at the state and local level?'' and "Whether 
uniform national standards are ai)propriato when thm^, are wide 
variations in the resources available to school system across stat(^s?'* 

We have already addressed the issue of "imposing'' national 
standards in our earlier discussion of "voluntary vs. mandatory" 
education standards. Here we assume the standards would be 
voluntary but consider the desirability of developing and 
recommending them at the national level rather than leaving this task 
solely to the states and localities. We consider first the desirability of a 
national consensus around specified content goals and then we move 
to the issue of variation in state and local resources. 



f». There are a lar^e miniher of examphvs ol' situations where poor and minority sliuients have 
heen given rhallenKin^?. higfi (jnallty content and instriK lion and performed to hi>»h levels of 
a(hiev(»inent. T\\v stor>' of Jaime Hsealante's work in high .school luallu'matics may he the 
best known. 



h'i::l 



What Would Be the Effect of a National Consensus Around 
Education Standards on Our Educational System? 

• The Task Force believes that a natioyial comeusiis around 
education standards could enhance the sense ofuatioruil 
identity and communit/j we need as our Nation becomes 
increasinglii diverse. National standards could form a cor(\ to 
which stales, localities and schools could add standards tailored to 
the needs and interests of their st udents and conuTuiniUes. (Jiven 
such a consensus and systeMti, we as a Nation could acx'oinniodale 
div(- '*sity and still have^ a ineai\s of achieving a prinu^ purpose^ of 
public schooling: creating an informed citizenry that shares 
underlying valuers about democracy. 

• Of course, there is a dariger and counter-arfjuufent, nameti/ that 
national staruiards might be too centralizimj, might in fact 
co}fstrai:n states, communities and schoolsfrom responding 
effectiveli/ to the ili verse goals and )ieeds of their constitnents 
and students. Several safeguards in the system could prevent such 
a situation from materialising. 

First, as stated previously, the standards would havt^ l.o be national 
and voluntaiy, not federal or mandatoiy. 

S(H:ond, the .standards should he developed and vienvcui as a 
common core that, where adopteKl, would be enhanced through 
consid(M^abl(> state and local flexibility. For e^xample, while national 
standards should be sufficiently de^tailtHl so as not to be vagu(\ tluy 
should be .sufficiently general .so as to [)ermit .schools and teachcM's to 
develop th(Mr own detailed curricula. One form that this fiexibility 
might take would be to build in .state and local choices and options, 
as in the .sequencing of subjects or iii the choice of lileratun^ within 
each genre, AnothcM* form would be l\\e addition by states and 
localiti(\s of their own unicjue content and performance^ exp(H!tations 
to rc^flecr their own hi.stori(»s and populations. This notion of 
flexibility within a common con^ is supportenl by a variety of 
evidence. R(\search in the United States, for (\\ample, shows that 
central curricula are only one of many influences on teaching and 
that ambitious new state content frameworks are being inlerpr(^t(Hl 
by teachers in a variety of ways. At th(^ sam(Minu\ experiences from 
other c()untri(\s also provide various practical models for building 
k)cal tlc^xibility into a national framework. 

A third factor mitigating against ov(M'-c(MUralization is that ttu^ 
national .standards could build m Ihv alnvuly significant work don(^ 
by a mnnber of states in reaching conseu.sus about ambitious 
stU(l(Mit ontcon!(\s. ('alifornia New York, Kentucky, Vermont, South 
Carolina and other states have chvc^loped or an^ bc^ginning to 
dfW(^lop standards that national groups could aclapt, adopt, mirror, 
or borrow from. By building on mon^ locally (h^ived cons(Misns, the 
national standards would not pr(\scrib(» as much as th(\v vvoukl 
reinforce what has already hvvn agrcunl to. 

Are National Standards Appropriate Given Wide Variations 
in State and Local Pascal and Human Resources? 

Advocates argue that a benefit of a .set of voluntary, chalk^iging, 
national standards is that where adopteni lh(\v will pr(;vi(i(» an 
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imdeMiyiiif? commonality and standard of quality for the education of 
our Nation's youth, thus serving? to protect the national puhlic 
int(^rest. Such, at least, is the ovcrridinj?goal, A mitij^ating factor in 
achievement of this goal is the fact that diversity in student 
populations and variation in state and local resources will contribute 
to observed variation in performance and delivery standaixis among 
and within states. 

• Will clidllcnginfj iiatioiial sfoNdards son^r as cowvton (joalsfor 
states and localities which have iridelij iHinfitig resoic^ces? 
Variation in rt^sources should not be used to justify and excuse wide 
variation in the quality of content presented or the levels of student 
performance, as now occurs. The Task P'orce believes that, instead, 
well d(Tmedand chalkMiging national standards (content, 
performance, and delivery) can sei-ve both to point out problems 
and to establish clear t argets for all states and localities to strive for. 
This is a similar argument to thai us(h1 earlier in the discussion of 
equity issues. A primary condition that nuist be mvi, of course, is 
that slaters adopt the standards. Our sense is that this will depend on 
the (juality of the standards. If the standards are of the highest 
quality, there will be great moral and political prc^ssure on most 
states to adopt them. On(^by-i)roduct of adopting and implementing 
the common standards will be that comparisons among states in 
student performance, which already exist and will contimie to exist, 
would have gr(^at(^r validity and h^gitimacy. This fact could cut both 
w^ays as states consider whether or not to adoi)t the common 
standards, 

•States leould not he confined to their (urn resource base in 
stririNfi toward c())nni()N, hi(fhcr standards. States and localiti(^s 
could w^ork togethf^r through regional consortia or othc^r 
cooperat ive groupings as many alrc^ady mv - - to ov(^rcome 
differ(^nc(^s and df^ficic^ncies in rc^sourccvs, Such coopc^alion could 
easily h^id to higher quality curricula, instructional materials, 
teacher professional developm(*nt, and/or assc^ssnu^nt instrumc^nts 
in ordc^r to help ensure^ highe^r levels of student perfoniumcc^ on the 
content and performance standards in all the i)arti(ipating 
localities. 



Feasibility and the Standard-Setting Process 

This part of tlie report addrc^sse^s tlu^ (iU(\stions on leasibility in tlu^ 
Hous(e report. 

Feasibility 

('an this Nation d{»v(^lop high quality (U)ut(^iU, p(^rformanc(\ and 
delivery standards? 

Testimony and Direct Evidence Indicate That It Is Possible 
to Develop High-Quality and Challenging National 
Education Standards. 
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The National Council on Education Standards and Testing has heard 
considerable testimony from teachers and other education 
professionals in the five subject matter areas, from states, and from 
the developers and the governing board of the National Assessment of 
Educational Progress (NAEP). In addition, the Council has received 
information from the College Board about their A? and Achievement 
examinations and from a variety of sources about the experiences of 
other nations. This testimony and evidence indicates that: 

• High quality and demanding national content standards have 
been and can be developed. The NCTM standards are an existence 
proof for the United States for national content standards which 
encompass Kindergarten through Twelfth grade. The California 
P'rameworks are examples of high quality contevi standards for our 
most populous and diverse state. 

• Demanding peyformance standards for students have been and 
can be dei^eloped. The performance standards for the AP 
examinations are an example in the United States. (For more 
discussion of this issue see the report on assessment.) 

• The Task Force believes that appropriate delivery standards 
could be developed for meeting the demands of challenging 
content and peyfoyynance standards, but there is little relevant 
experience in the United States. In the United States, delivery 
standards (i.e. accreditation standards) have typically been 
developed independently of the curriculum since there are no 
common content standards. P or the United States, the specification 
and use of delivery standards associated with common content 
standards (e.g., high quality curricular materials and professional 
development programs based on the content standards) would be 
breaking new ground except in rare areas. One exception is the 
guidelines for instruction proposed by thr NCTM which is associated 
with the NCTM Standards. Other exceptions are the materials 
associated with Advanced Placement courses and the International 
Baccalaureate. 

Although Examples of Challenging Frameworks and 
Demanding Performance Standards Exist in the United 
States, this still Does Not Demonstrate the Feasibility of 
Developing Challenging Educational Standards Which Are to 
be Explicitly Adopted as National (Although Voluntary) 
Is not the Nation too ethnically and culturally diverse and are not our 
traditions too rooted in state and local governance and control to 
allow us to reach the national "consensus" over content and 
perfonnance standards that would make their development, 
ultimately worthwhile? There are a number of key Issues here: 

•A byproduct of this argument raises tfw possibility Uiat national 
standards, developed by consensus, will not be challenging. 
Experience in education and in other sectors teaches us that 
standards set by governments are likely to be set at nnmnmrn levels, 
the lowest common denominator. CAirrent debates over the extent 
to which content nmst reflect the racial and ethnic diversity of the 
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Nation, and over the extent to which each school's focus must 
reflect its own racial and ethnic makeup, underscore the difficulty of 
reaching "consensus" except at a superficial level. In addition, 
"consensus," and therefore acceptance and ownershii: , is 
endangered by disagreement over controversial curriculum issues, 
like the teaching of evolution. However, a variety of experiences 
provide counter-examples to these arguments. 

• The fact that challenging and high quality content standards, 
even in sensitive and particularly complex areas such as 
science and history/social studies, have been dei'eloped in a 
state like Caiiforma, which has great diversity, indicates that 
the challenge of diverse opinions can be overcome by hard work 
and careful attention and respect for differences of opinion 
among the vanous interests. California has been able to adopt 
sophisticated and complex curriculum frameworks in mathematics, 
social studies, and science. We are not suggesting that the task will 
be easy — witness New York stale's recent experience with their 
Histor>' framework — but we do believe that it is feasible. 

• The fact that the NCTM as a professional group has reached 
national ''consensus'* on conteyit standards is a positive though 
not (mtirely convincing argument for ou r ability to bridge the 
strong state and local traditions of our Nation, The nationwide 
agreement among professionals in mathematics and mathematics 
teaching reached by the NCTM on very challenging content 
expectations are echoed by the experiences of the several sulyect 
area standards Task Forces formed by the National Board for 
Professional Teaching Standards (NBPTS). Neitherofthe.se efforts 
reflects any watering down of content or avoidance of controversial 
issues. As the NCTM standards or closely cloned versions of the 
standards are adopted by more and more state Boards of p]ducation, 
the argument for the power of compelling, high quality, yet 
voluntaiy, national standards becomes more convincing. 

• It is clear from these examples ( and from others such as NAEP) 
thai it is feasible to develop national education standards which 
are far more ch^illenging than the de facto, winimal, basic skills 
standards which yresently drive much ofAnwrican education. 

Standard-Setting Process 

Even with these examples of the feasibility of dc^veloping challenging, 
voluntary, national standards, however, we do not know tho extent to 
which the standards will be embraced by the public and thus the 
extent to which they v/ill ultimately affect our Nation's schools. T(; an 
important degree, the Task Force believes that the extent of the 
influence will depend Uf)on the level of ownership of the new 
standards felt by the Nation's education profession, federal, local and 
slate policy makers, parents of all children, and the pul)lic. Ownership 
of the new national education standards by these various (^onstitue'iits 
will be an essential cornerstone of the Nailon's commitment to change 
the content and quality of instruction in our schools. Moreover, 
ownership of the new national standards will generate a vision to 
guide the actions of stat'; and local policy makers, to focus reform and 
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the use of resources in schools, aiul to provide purpose and content to 
teacher professional development. 

How Can a Process for Developing National Education 
Standards Be Created that Will Ensure that All Interested 
Participants^ Including Teachers^ Have an Opportunity to be 
Heard? 

For national standards to form the basis of a shared national vision of 
what schools can deliver they must accurately reflect what we as a 
Nation want students to achieve. They niust represent a true shared 
understanding of our goals for student academic achievement. Yet, 
how can we expect policy makers, the public, and many education 
professionals to aspire to new and challenging standards if they have 
not had the opportunity to be exposed to them? In order for the public 
to embrace challenging standards of "world-class" quality, it must be 
given the opportunity to engage in a national discussion with concrete 
examples of high quality content aiui student performance. Kxpert 
judgement must be discussed, debate^d, and refined by widespread 
publi(r participation. Parents, business leaders, citizens, political 
leaders, university edu^'ators, and even students throughout the 
Nation should be involved. 

Approaches to Standard-Setting 

While there are a variety of ways that a standard-sotting process could 
be conducted, there are three main approaches. 

• The first approach is the most efficient i)i cost and time: it 
begins at the national level and relies largely on professionxd 
input from throughout the /Va?.'>^//. This is the model that has 
traditionally be used by NAEP though recently the NAKP process 
has broad(MU^d significantly. In this model no direct attempt is made 
to influence the minds and hearts of most state and local educators 
and policy makers, parents, or the public at large. 

• The second model begins at the local and state level (uid 
generates existing documents and concerns that are 
s}pdhesi;ted at the national level This model l»as tlie advantage of 
building on existing work and has some substantial grassroots input. 

• The third model starts with professional jadgement and 
examples from the naHonal level and tfnm looks to the state and 
local level for guidance from a wide variety of sources. In this 
third model prototypic education standards would move through at 
least one and preferably two iterations from the national to the^ stat(» 
and local levels and back for continued refinement. As the iterative 
process continues the hope is that (nvnership by all groups across 
the Nation would substantially incn se. This is similar to the model 
reconunended by the technical advis( >i y group i ( loal 3 of the 
National Education Goals Panel. 

Task Force Recommendation 

The Task Force recommeiuis the third model. Though we recognize 
that it would be the most costly in time and money we believe the 
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investment would be worthwhile. Our strong sense is that this model 
offers the best chance for engaging a wide spectrum of the public and, 
consequently, has the greatest promise for helping in the successful 
implementation of the new, challenging education standards 
throughout the Nation. 
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Report of the 
Assessment Task Force 



Introduction 

Part of the Councils congressional mandate is to report on the 
following issues: 

. . whether, while respecting state and local control of education, 
an appropriate system of voluntaiy national tests or examinations 
should and can be established, such as American achievement 
tests, that will provide prompt, accurate information to parents, 
educators, and policymakers on the progress being made toward 
the specific education standards by individual students, schools, 
school systems, states, and the Nation as a whole (if such 
standards can be established). The goal of any such system shall 
be to foster good teaching and learning, as well as to monitor 
performance/' 

"A discussion of the validity, n^lialiility, fairiu^ss, and costs o!' 
implementing a system of voluntaiy national tests or examinations 
shall also be iiu:luded in such report." 

It is our purpose to consider the desiral)ility and feasil)ility of a syst(^m 
to assess the National Education Standards. Our report v\111 address 
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the validity, re^liability, fairness, cost, and, particularly, potential 
impact on students with special needs. The report is organizcul into 
five se(!tions: l)background, where we provide context for our 
deliberations and discuss important terms including assessment 
purposes, uses and misuses; 2)desirability, where we consider the 
present assessment system, a sample of arguments for and against a 
system to assess national standards, a set of desired principles and 
requirements for the system, and propose state and national functions 
and rok\s in a new system; 3) feasibility, where we identify issues that 
must be solved to assure feasibility; 4)implementation, where we 
propose early steps to be taken; and 5)issues, where we discuss 
concerns the members of the Task Force wish to bring to the 
attention of the Council. 



Background 
Context 

For many Americans, the vision of a renewed educational system 
includes assessment as a central component. They desire^ a system 
where assessment challenges all students and educators to do their 
best, opens up new opportunities and accomplishments for everyone, 
and pro\1des incentives to improve the quality of Americ^a's schools. 
These hopes arise from a variety of perspectives — from tlu^ big 
picture — that our Nation cannot permit its (niucation system to 
erode if we are to flourish in the future; and from close-up 
experience — that education is fundamentally a student-by-student 
proposition where rich accomplishm(»nts, verified by assessments, can 
develop a child's abilities and sense of worth in positive and powerful 
ways. 

We ap|)roach these compelling goals for assessment with many 
reasonable^ reseiTations. First, W(» n^cognize that any national system 
must honor the traditions of local and state re\sponsibility for 
education and, consequently, for flexibility and adaptation. Second, 
b(^cause of o\ir (extensive exp(M*ience with tests, data of otiuM* types, 
and accountability attempts, we realize we must have* high standards 
for the quality and fairness of the assessments. Third, a!i assessment 
system of th(» scope imagined is a new (enterpriser for our Nation, so we 
must make sure we avoid the salient harms unintentionally created by 
assessment syste^ns in the past. 

Our deliberations have been sometim(\s contentious — aspirations 
differ; reservat ions vary; evideiu'c is e'reniible* le) sejuie^ anei but ne)t te) 
e)thers. We have e)mitteHi the teu'hnieial eieM ails of e)ureiisagreeMnents 
anei have de\seTibed basie: principle\s about whie'h we agree - 
prine-iples thai must be fe)lle)weHl if any asse\ssment sysleMU is to 
provide beMiefits while^ e)ffering neenieHl pre)tee'tie)n. If reMjuireMueMits we 
pi'0|)ose^ are met, we^ belie^ve we may succenKl. We believe we have a 
place for this Nation to begin. 

Purposes^ Uses^ and Misuses of Assessment 

A system te) assess the^ natie)nal standareis may have* many purpe)ses, 
ame)ng which we distinguish five: 
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• monitoriiij? progress toward National P]ducation Goals 

• holding schools or students accountable for performance 

• certifying individual achievement and accomplishments 

• improving instruction 

• evaluating the effectiveness of schooling or reforms 

Each of these five functions is assumed to be in the servic * ot larger 
goals — the improvement of our children's accomplishments and the 
quality of their educational experience. Nonetheless, these five 
functions are distinct and impose different requirements on an 
assessment system. 

Tht) followii g section is offered to explain frequently used terms as 
well as to help the Council use the common language when discussing 
the content of the report. 

Monitoring 

Sound educational policy decisions I'oquire dependable information 
about achievement of the National P]d;Jcatioi\ Goals, i ieally this 
information provides an independent and relevant picture of 
educational progress. This information can be acquired in cost- 
effective ways that do not require the^ assessment of every student or 
school every year. P]xamples of monitoring assessment systems are 
the National Assessment of Educational Progress (NAEP) and many 
existing state assessment progi ams. 

Accountability 

Tests and assessments are frequently viewed as means of holding 
schools and educators accountable ("or student achievement. Test- 
based accountability has, in the past, focused attention on the goals 
and content that are tested. Unless tests focus on the full range of 
important outcomes, ( nrriculum and instruction become narrowed. 
Accountability does not have to depend only upon test results. For 
example, we could hold s( hools and educators accountable for 
promoting high levels of competence in certain subject mat ters and 
for assuring that all children have a wide range of important learning 
opportunities in untested areas, such as foreign language and the arts. 
Systems could be held accountable to assure that qualified teachers 
are teaching in given subject areas. What nmkf?s accouiUability 
l)roblematic in every domain is the pressure it creates to find 
inappropriate short-cuts in order to produce "good results." The 
higher the stakc^s, the greater the pressure. Thus it is important that 
the assessments, as fully as possibl(\ \vf\vv[ all important goals. 
Furthermore, we nuist be vigilant that the inte^grity of the assessment 
is protected against corruption of various sorts. For these reasons, the 
same assessments can almost never provide simultaneously good 
monitoring and accountability information. 

Certification 

The use of assessments to f ertily tlu^ accomplishnuMits of individual 
students is undertaken for many purposes: to develop higlily 
accomplished members of our society, to dimionstrate and focus the 




impact of educational services, and to encourage student effort to 
achieve valued ends. For all of these purposes, it is essential that 
standards of achievement, the steps that will help students progress 
toward the required standards, and the benefits of certification be 
communicated openly to students, teachers, parents, and the public. 
Because of the consequences of certification for an indi\^lduars future, 
the certification purpose of assessment also carries with it the 
strictest technical criteria for validity and fairness. Standards and the 
tests that measure them for one individual's certification need to be 
equivalent to the standards and tests used for any other individual. 
Furthermore, certification assessments that tie consequences to 
individual performance — for instance, denial of high school diplomas 
~ or are required for particular employiiienl, have specific legal 
precedents that set useful and important standards for instructional 
environments or the relationship of the assessment to actual on-the- 
job skills. 

Instructional Improvement 

Assessment can be an integral part of effective teaching. Indeed, the 
best assessments and instruction expect the same active involvement 
of students in problem solving and the development of skills and 
understanding. Assessments that are used to improve instruction, 
however, are likely to differ from those used for the other purposes 
noted above in a number of important ways. The key audiences for 
assessments intended to improve day-to-day instruction within 
individual classrooms are students, teachers, and parents. Intensive 
teacher involvement in the development, scoring, and use of 
assessment information may be critical to this instructional 
improvement function. Assessments used for this purpose must 
provide timely feedback on student performance to both teachers and 
students, and they must provide both teachers and students with 
clear models of the learning and performances that are desired. In 
addition, the needed frequency of assessment is likely to constrain the 
usefulness of external tests more for this purpose than for the others, 
because teachers must make myriad and frequent decisions about 
instructional content and style. 

Evaluation of Schooling or Programs 

The evaluation of schooling requires more than only (lep(MKlal)le 
information about student academic achievement; it may also require 
assessment of non-cognitive outcomes, like attitudes, levels of 
participation, and interests as well as clear information on parental 
education, poverty and other non-school factors. Assessments 
design(^d for monitoring purposes can often be used in evaluation 
studies, but, in addition, it is almost always expected that the 
evaluation will allow inferences about the likely causes of asspssed 
performance. These causes or iniluences may be the impact of 
particular reform interventions, in combination with student 
background factors. To draw strong, cor^clusions, it may be nec(\ssaiy 
to collect iongitudinal information on the same students to assess 
their growth in achievement and other desired outc jmes. Uses of such 
evaluation may be formative, to improve the particular program or 
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schooling effort, or sumniative, to make a go-no-go decision about a 
particular program or strategy. 

High-Stakes Use 

Much conversation in assessment focuses on high-stakes uses of 
assessments. But what constitutes liigli stakes? The phrase means 
different thhigs to different people. In the present context, however, 
the key is whether performance on the assessment has substantial 
consequences for participants in the educational system. The 
consequences of an ass(\ssment might be desired by or imposed on 
students, teachers, or administrators. A clear form of high-stakes use 
is individual certification, in which some important event — for 
instance, graduation from high school, admission to college, or 
selection for employment — is made contingent on performance on an 
examination. Other relatively high-stakes uses include proposals to 
make teachers' compensation or sU^te financial aid to schools or 
districts contingent on scores. High stakes occur wlien test r(\sults are 
used to compare schools in choice programs. An essential and 
complicating lesson of the test -based reforms of the 1980s, however, 
is that tests can become high stakes even in tlie absenrr of severe, 
externally announced sanctions of this sort. In somt instancies, 
publicity alone was sufficient to spark a chain of ev(*nts sufficient to 
make t(\sts high stakes, fcr example, by inducing district or building 
administrators to use* test scores as an important criterion for staff 
evaluation. Wheriever consequeiiff^s of te.^t scor(\s are substantial for 
individuals, issues of validity, r(elial)ility, and fairness bc^comc^ luo'v 
difficult. Where high stakes are more a matter of perception llian 
actual coiiseqiKMices, issues such as fairness may be less sali(MU, but 
the risk of unintended deleterious (effects on instruction and less 
trustworthy results are substantial nonetheless. 

Test Misuse 

Concerns for misuse f)f tests and oilier assessments are at liie con* of 
many reservations about llie imph^mentalion of mandated 
assessments as instruments of naiional policy. Why is this issue so 
important? Fiefi^rences siicli 'dii\hvSt(utdar(hJor fJdurati()}ial and 
Psychological Tests and the re[)()rt of tlie National Academy of 
K(lu(!atioji emphasize, among other issues, llial ttu* valiriily of an 
instrument or assessmc^nl does not soh^ly r(\side in the tc^st ilsr^lf, but 
d(»pends as well upon {hv ways test results mv used. At Hk* most 
global k^vel, misuse* occurs whe^i results are used for uninlendeul 
purposes. And it is important to note* that significant vvrit(*rs in the 
fi(*ld bf^lieve that diffen^nces bdween appropriate use and misuse^ dvv 
not alw^ays ciyslal clear. Owo kind of misiisf^ involv(\s an inappropriale 
interpretation of tlie purpose of tlu* test. For exampk*, a misuse 
occurs when tests that arc* intendc^i to provide^ information on 
strengths and \v(uikness(\s to i^nprove instruction arc* used to label 
stud(*nls. Anoth(*r misuse iiiiglil result from using a measure with a 
weak base of evidence, for instance, in making cc^rtain certification 
decisions based on a single, weakly validated m(*asiir(\ A third misuse 
involves the c()nsequ(*nces of usirig given mc*asur(*s to make d(*cisi()ns 
ab'jut stU(l(Mils resulting in unfair d(*cisions. Misuse* is a paramount 



concern because if misused, tests can undermine efforts to improve 
education and can harm children. Misuse is important because it may 
lead to erroneous judgments about educational performance. Tests 
are not valid in and of themselves; rather, they are valid only to the 
extent that they provide a frm basis for reaching specific conclusions. 
A test that is v^ell suited to supporting one type of conclusion may be 
entirely inadequate for supporting another. One use — or misuse — of 
a test may undermine its validity for another use. For example, using a 
test for accountability — and theieby encouraging teaching to the 
test — will generally undermine the validity of that test for monitoring 
progress. While there are many other instances that can be cited of 
test misuse, it is important that reasonable steps are taken in any 
proposed system to avoid the harms caused by test misuse. 

Desirability of System to Assess the National 
Standards 

Present State of the United States Assessment System 

Education in the United States is test-happy. We expend significant 
resources on student testing, data collection of *4iard" information, 
program evaluations, and report preparation — all undertaken 
nominally to meet the major purposes of assessment. Fv^w believe that 
the present system is successful. Information is inconsistent and often 
incoherent. The information provided is seldom timely and there is 
little articulation among tests given for elementary, middle, and 
secondary school students. Despite the preoccupation with testing, 
we have no real assessment system. How can we explain our 
predicament? 

• Many external tests and assessments float free of the (^on^ reality of 
classrooms, curriculum, and teaching practices. Teachers are 
expected to "use'' test results to improve their day-to-day 
instruction, but rarely are assessments, curricula, texts, and 
tea(rhing practices aligned. Tests and textbooks often emphasize 
different goals and content. Moreover, teachers are taught in 
teacher education programs ''book-learning" about tests, but not 
much about how such information (.'an be of practical use. Sadly, 
knowledge provided by test results has v^i been "power" for 
teachers. 

• Test-based accountability, while a compelling idea, has seldom 
worked in its present form. Standards of performance may be 
lowered so that schools will not look too bad. Test c:ontent is 
simplified. The press and public make incorrect inferences from test 
scores. Because the tests may not be aligned with curriculum and 
instructional practices, there are no c^lear guidelines for how 
teachers ci \ use the test information to improve instruction. 
Consequently teachers, onite rationally, may teach children "test- 
taking skills" rather than ^^'t matter. Valuable instructional time 
is spent practicing similar it or tasks as on the test — a 
reasonable but ultimately counterproductive alternative because 
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tests always are limited in coverage. Effects are worse when test 
items are shallow or trivial. The curriculum that children are taught 
constricts to what is on these tests. 

• Some but not all analysts believe, therefore, that our tests can be 
blamed for much of the poor teachii ;g and low quality materials 
found in some of our schools. Many tests provide a model of "quick, 
right answer," piece-meal learning, and artificial divisions of subject 
matter into microskills. These tests are thought to exemplify a 
discredited view of learning — a view that basic skills must be 
learned before complex thinking. While it is arguable that tests alone 
are responsible for the type of instruction found in all too many 
schools, it is clear that we have not sufficiently explored ways to 
assess students' deeper knowledge of subject matter, complex 
problem solving, and clear communication. And what about good 
citizenship, commitment to hard work, and team building? What 
about subjects other than the core subjects? 

• Even high quality tests may be misused. They provide an illusion of 
precision. Federal testing requirements for program services and 
accountability result in classifying students in ways that frequently 
retard student progress rather than support it. Assessments have 
included material that is biased against children of different races 
and gender. Mandated tests have a particularly bad track record 
with Limited English Proficient (LEP) students, disadvantaged 
students, and other special populations. Some test misuse in schools 
occurs without sanction, despite the dismay of test experts and 
commercial testing companies. 

• The costs of our present system are high, not so much because the 
tests and information are expensive but becaiise they are so rarely 
used to make things better. Bureaucracies demand accountability 
reports for Federal and state funds. These re[)orts seldom inform 
policy but provide the appearance of "bottom-line" management. 

• A bright spot is the NAEF, which in its present model with current 
constraints provides reasonable information on the quality of the 
Nation's achievement. It functions well as an independent 
mechanism to monitor national and state progress toward the 
National Education Goals, particularly Goal 3. NAP]P can do this 
because it is not burdened with more than one purpose. If we were 
to add accountability to its purpose of monitoring national progress, 
its continued utility for monitoring would be questionable. 

• The present system also has many resources in the form of expertise 
of commercial develoj^ers, and innovative new assessment.', coming 
from them and from the schools, universitir\s, and fiedicated 
individuals committed to improving the way we assess students and 
use results. 

In sum, our present system of assessment has substantial weaknesses 
as well as some strengths, and many of us believe that it cannot serve 
as a major impetus for fundamental change. The issue before the 
Council is whether, and to what degree and \inder what conditiotis, a 
new assessment systeni would be better able to assist in the current 
reform agenda. 
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We have at least two reasonable alternatives: l)iiot to use 
assessment as an instrument of educational policy or 2)to redesign a 
new strategy from the ground up to assess national education 
standards. 

Arguments for a New Assessment System 

A sense of urgency coupled with persistent AmcMioan optimism has 
resulted in a raft of arguments for a new assessnuMit system. Some 
arguments are put forth with a particular vision and belie^f that it is 
most critical to change the form of the tests from multiple choice tests 
to performance-based tasks. Others hold that attaching real 
consequences to performance is (essential. Below is a sunmiary of l h(» 
range of aspirations for a new assessment system (but not nec(\ssarily 
a single national test). Notice that there are conflicts and tensions 
among some of these arguments. The first set of arguments focus on 
assessments in general, 

• Assessments the critical instrumcMit of educational policy. They 
are a cost-effective^ lever for changing the systc^m. The^y give us 
something to shoot for. They let us know how we^ are doing. Thvy 
will motivate students, their parents, and the system to work harde^r. 

• To motivate students and teuichers to work harder, new ass(\ssm(Mits 
must have consequences for the world outside of school as well as 
that inside of school. If asse^ssme^its count, in the job market or for 
college application, stude^its will try harder. 

• Both special education and LKP stude^nls have bec^n (^xcludc^d from 
assessments. The^ major problem with this approach has bc^en that 
these students are thei\ plactni **outside^ of accountability." A more 
inclusive approach towards assessment is nee^ded if equity concerns 
are to be rc^spected. 

• America needs a wake-up call, in fact, each local comiminity needs a 
wake-up call. Only clear tevst r(\sults will convince local c()n\munities 
and parcMits that their own school and their own children may have 
serious problenns. 

• ('ommon ass(\ssments are an (\ssei\tial compone^nt to open up choice 
of public schools or education program to parcMits, 

• An assessment system will give reiu^wed me^aning to higli school 
diplomas and restore public confidence in educational institutions. 

• Recent polls show that the public wants some^ form of national 
testing. They want to be able to know how kids in diffcM'cMit schools, 
districts, and states compare against common standards, 

• Te^sts can help to ovc^rcome inequity, Stude^nts sliould be judgini on 
how they perform and not on other charactt^ristics. llr\l(\ss all 
stu(i(MUsare hc^lpcvl to achic^ve high stai\dards, vv(^ will pe^'petuate, if 
not exacerbat(^ the class and racial divisions in this Nation, 

• If the (Mlucation goals and standards niv going to b(^ iiujre than 
rhetoric, we^ must assess our progress toward th(Mr achievenuMil. 

• Kducation has not improvcMl iM^cause tests hav(^ few r(\'il 
consequences for students. Students must be held to higli standards 
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and not passed through the system because of time spent in 
classrooms. 

• Test-based accountability is the "bottom line" of education. Until 
teachers and administrators are made to feel resi)onsible for their 
students* performance, they have few incentives to change vhat 
they do. 

• Our evaluation systems have too many mind-numbing procedural 
requirements. We need to allow more cn^ativity in the system by 
holding schools responsible for outcomes and let schools develop 
ways to achieve them. 

Some arguments for a national system of ass(\ssnient (k»pend upon a 
specific vision of assessment and tests as part of a larg(»r (Hlucationai 
reform effort, ('ritical to this view is the importance of aligning testing 
to curriculum and instruction. Arguments in support of this view 
include the following: 

• Our international i)artners in Kuropeand Asia have (Mlucation 
systems that produce a high level of literacy and c:oinpetence. 
Testing linked to curriculum is a coinpoiuMit of th(\se systems. A 
national examination system, based on clear curricula and on 
examinations that can be prepared for, could also hv used in this 
countiy. 

• Aligning standards, curricula, and tests will permit clear 
communication to all constituencies in the educational community. 
Information from measures will make sense and educational 
resources can bc^ cohen^itly focused to ra{)idly improve our status. 
Evidenice in support of this vic^w can b(^ seen, for one segment of the 
student population, in the recent report of Advanced PlaceMuenit 
Tests. 



Other argumeiUs hinge onWw use of a particular form of assessment 
as a way to intc^grate curriculum, teaching, learning, and asst\ssment: 
performance assessmcMit. P(Mlbrmai\ce assessment requir(\s students 
to complete challenging tasks that call for deep understanding of 
subject matter, problem solving, ai\d communication. Thes(^ tasks may 
b(^ conceived as extended projects, hands-on demonstrations such as 
conducting experiments, or portfolios, wh(M"(^ students include^ 
evidence of a rangc^ of acc()mi)lishments or tluMr developed expert is(\ 
CurnMitly iuim(^rous local and state (Hiucalion ag(Micies are developing 
such assessments. Among the advantages cited div: 

• AssessnuMits can hv mow (Migaging for stU(l(Mits and more 
understandable to parents and the community. 

• Working on the development and the cwaluation of ptu'formance 
tasks provi(l(\s an invaluable^ experi(Mice» for teacluM's. Performance^ 
assessment l)rings together assessineiU. and tc^achingin a powerhil, 
concrete^ way. 

• Scoring i)erformanc(Sissessm(Mits (Miabl(\s teachers to (h^velop a 
clear understanding of the (iualitie>s of successhil work, i.e.. \v\vM it 
means and how^ to recognize it. Students can us(^ the scoring system 
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to assess their own work and internalize high standards. 

• Performance tasks provide models for teachers of the best 
instructional practice. Even if a teacher does not help design a 
performance-based assessment, she or he will be given a dramatic 
new way to conceive of and to improve instruction. 

• Performance assessments that are cumulative encourage students 
to take responsibility for their own learning by reflecting on their 
own work. 

• Because of the integral relationship of performance assessment and 
learning, the harms previously associated with mandated 
assessments will be mitigated. 

• Numei'ous local and state education agencies are developing these 
assessments already, with rei)orts of great enthusiasm by 
participating teachers. We have an eager clientele for educational 
assessment of this form. 

There is considerable sentiment, momentum, and passion for the 
development of new assessment systems. 

Arguments Against a New Assessment System 

Yet there is no shortage of arguments against a national system of 
assessment. Parallel to the arguments by assessment proponents, 
opponents frame their objections in the light of certain assumptions 
about the planned system. Again, let's begin with the most general 
concerns ~ pertinent to almost any system of assessment that may be 
envisioned. 

• Externally mandated t ests have not worked in this country. There is 
no reason to believe they will work this time. 

• A major danger of a national system is that it will be asked to fulfill 
too many purposes simultaneously — monitoring progress toward 
national goals, instructional improvement, accountability, and 
certi.Hcation. No single measure can meet these multiple 
responsibilities. 

• We already know our system is in trouble. Let's fix it before we test 
it. We do not have resources ei^ough to spend on teaching, books, 
and chalk. 

• Th(^ environments from which some children come — with 
conditions of poverty, poor health, and inadequate family support — 
make our educational system less likely to be successful with tests 
or without them. 

• A national assessment system will exacerbate rather than solve the 
equity problem. Sports metaphors notwithstanding, having tests will 
not level the playing field. Disadvantaged children, LEP students, 
and children with various special needs hnve to go farther to meet 
the standards. They may fail and be left behind 

• National tests mean national curricula. They will inevitably result in 
the usurpation of (Hiucational authority from states and localities 
and result in greater centralization of control 
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• Extrapolation from European systems is inappropriate. The United 
States has greater challenges in the diversity of its student body, no 
formal policy of early tracking into academic and vocational 
programs, no nationally centralized curricula, and no recent 
tradition of a highly regarded teaching profession. European 
countries have a range of social, health, and family support systems 
lacking in this country. 

• A national assessment system by itself will not result in educational 
reform on the cheap. Without resources to build the infrastructure 
we need to improve curriculum, teaching practice, and the quality of 
teachers going into the schools, we are doomed. And even if we had 
the national will to make these changes, we don't have the resources 
to do so. 

• Standards are a big step forward, but so far our examples are very 
generally phrased and may be subject to wide interpretation. We 
need carefully constructed curric before we can develop 
adequate assessment instrumenib. Specific tests, if created before 
specific curricula, may drive educational reform in a direction 
undesired by educational policy makers and repeat previous 
failures. So we can not do this tomorrow. 

• Holding students accountable or requiring certification that has real 
consequences (for graduation, employment, or opportunity for 
further education) may be subject to judicial challenge unless school 
systems can demonstrate that adequate notice of expectations and 
reasonable opportunity to learn have been provided. 

Some negative arguments focus on a system of assessment that would 
permit individual states or groups of states to develop their own 
performance assessments of the national standards. Illustrative 
concerns include: 

• Validity studies of performance assensment are just beginning and a.s 
yet we do not have strong evidence in support of performance 
assessment. At this point, they are risky for use for student 
certification or other high-stakes consequences. 

• Fairness of performance assessment results may present problems 
for two related reasons. First, the evidence to date suggests that it is 
hard to demonstrate even limited generalizability — that is, 
successful performance on one task is related to performance on a 
similar but slightly different task or topic. If differen*^ students 
complete different tasks, assuring the comparabihty of their results 
is difficult. Secondly, the effect of comparability of administrative 
conditions will need to be deterniinc^d, so as to assure that all 
children are assessed under standard conditions. 

• Performance assessments may prove especially difficult for 
disadvantaged learners who have not had instructional experiences 
in extend(?d complex task perfomance. Evidence (from NAEP) 
suggests tliat minority students complete open-ended tasks at a 
much lower rate. Changing the kind of assessment is no immediate 
cure-all. 



January 24, 1992 



ERIC 



97 



• Performance tasks presently depend substantially on wi itten and 
oral comnuinication, even in subjects such as science and 
mathematics. LEP students could be unfairly affected by these 
tasks. In addition, ther ; may be more opportunities for biases based 
upon superficial qualities of language (such as a foreign accent or 
Black English features) to influence judgments. 

• The logistics of performance assessment raise questions of 
practicality. It is not an efficient format; provisions for students not 
being tested require extra resources if learning is to go on while the 
testing is in progress. 

• The costs of this system in terms of teacher development, task 
development, administration, scoring, and validation are so high as 
to be insupportable, 

Because the Council has already expressed sentimeni against using a 
single national test, no arguments, although the^y are numerous, 
convincing, and • t^'ong, will be put forth against that alternative, such 
as using an individual form of NAEP, 

Summary of Arguments 

Although it might be desirable, we have not presented counter- 
arguments and rejoinders to each specific point raised on behalf of or 
against a new assessment system. How (?an we sunmiarize the 
arguments? Some arguments for a national system focus on principles 
of good management, incentives, and communication. A set of these 
arguments implies that our failures with assessment and testing in the 
past can be overcome with new forms of assessments, assessments 
more closely linked to teaching and focused on valued 
accomplishments of students. These arguments are essentially 
optimistic and have relatively little evidence in their support. 

Arguments against a national system are based on our past 
experiences with assessment and on doubts that changes intended by 
new assessments will actually occur. New, performance bascnl 
assessments have not as yet accumulated a sufficient track record on 
validity, re^liability, fairness, practicality, and efficiency to permit their 
wholesale adoption as a national policy for all assessuKMit purposes, 
and for high-stakes purposes in particular, No single examination has 
been able simultaneously to serv^ the purposes of monitoring system 
progress, student certification, accountability, instruc^tional 
improvement, and school evaluation as wt^ll as maintain the validity of 
the measure for all its purposes. At minimum, we must consider 
different assessments for different purpost^s. 

One partial way out of this negativism is to look toward the 
provision of indicators of school and svstem capacity as means to both 
assess the (luality of the system and to provide* collateral evidtMice 
relevant to the validity and fairness of the student performance 
assessments. 

Although most interest and discussion have b(HMi devoted to the 
development of student assessments of the national standards, the 
adoption of capacity indicators requires a significant conunitment of 
energy as well. To this point, there have been nume^rous efforts to 
assess capacity, in terms of resources and education?;! processes. 
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Some have been created to report to the public on the status of 
schools, for instance, School Report Cards that include information 
both on capacity at the school and on school performance. Some have 
been used as accountability mechanisms with varying success. Some 
of these have been cast in the form of educational indicators of inputs, 
processes, and outputs as means to monitor and explain changes in 
our educational system. The recent report, Education Counts, 
prepared by the Congressionally mandated study panel on indicators 
provides a detailed vision of the benefits of an indicator system. 

Capacity indicators may provide sources of evidence that will 
increase our confidence in results on outcomes. But indicators of 
capacity are not without problems. One limit and consequently a 
source of tension is how to achieve some comparable level of 
reporting— from school to school, for instance— without overlooking 
special and important characteristics or efforts of the school. We also 
need to keep the level of documentation from being burdensome. 
Finally, we wish to reduce the likelihood that reporting on capacity 
will result in explicit regulation and prescription. 

How can we proceed? First, we must cut our intert?s< in capacity to 
the bare but essential minimum. Three attributes of system and 
school capacity are essential to the interi)retation of student 
assessment. (Depending upon the final character of the system and 
school capacity indicators, other elements may be added.) The 
minimal elements are: 

• (Kiual opportunity to learn curricula implied by ihi^ standards — 
learning rc^sources, instruction, curriculum, teacher and student 
assignment; 

• specific issues about environments for populations with special 
needs; 

• procedures to avoid test misuse. 

Information on th(\se points is essent ial to determine the validity and 
fairness for any high-stakes use of assessments. 

To summarize our views: 

• We all believe vv(^ can devise mt^hods to improve the way we 
monitor our progress toward national goals. 

• Most of us bc^lieve that we cannot us(^ traditional tests as 
accountability tools to improve performance. 

• We only have partial evidence on the lik(>iihood pcMformance 
assessments will be successful. We are conceTued that changing the 
form of tile assc^ssment will not solve basic problems of 
inappropriate use and we will need to build a can^fully d(K*umented 
set of experienc(\s about practicality, validity, reliability, and costs of 
their use for different assc^ssmenl purposes. 
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Our Vision: Toward a System to Assess the 
National Standards 



We conclude that there is no ready-made examination system 
available for instant use in the assessment of national standards. None 
brings together the hopes for assessment and the protection against 
previous failures. But we recognize that assessment is a critical part of 
the educational reform process and a desirable and appropriate 
requirement for public enterprises. We realize that we cannot wait 
until we have researched, debugged, and resolved every unknown. We 
must cautiously begin to move now. 

We recommend a fundamental rede, ign of our assessment 
system — a redesign that can start immediately but will take time and 

care to come to fruition. ,^ 

"^^^ 

• We support an assessment system that protects children from the 
harms of test misuse, from unfairness, and from poor quality tests 
and assessments. 

• We support an assessment system that holds schools accountable 
for providing high quality educational programs and for producing 
the int(>llectual accomplishments Americans expect of all of their 
children. 

• We support a system that fosters rather than inhibits creative and 
demanding teaching. 

• We need an assessment system to help us assess our progress 
toward the National Education Goals, and one that provides 
understandable information that will help mobilize families, 
students, educators, and the whole community to rededicate 
themselves to the cause of learning. 

Our strategy is based upon a few basic assumptions: 

• No one test or assessment should be asked to serve all the 
assessment purposes. We need, at this point, a system made up of 
articulated components, glued together by their adherence to 
content standards, and serving explicit purposes for assessment. 

• There is good in the assessment system that should be retained and 
expanded. Excellent progress in assessment design by states and 
localities and by commercial test publishers should be put to use in 
this new assessment system. Most of these efforts focus on the 
instructional improvement uses of assessments. 

• Sufficient safeguards must be built in to the system to protect 
children, particularly disadvantaged, LEP, and special populations, 
from negative consequences of the system while it is being refined. 
Further, assessment should be extended to areas of particular 
concern to these groups. For example, it is important to ensure a 
comprehensive assessment of English language skills for LEP 
students. 
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We propose, therefore, the (le?velopiT:ent of a system to assess the 
national standards which cleaves to the following principles: 



• !t is always conceived as a part of a larger educatioi\ai reform effort. 
Assessment is not adopted as a quick fix. 

• It functions as a system — not as a cacophonous set of information 
that provides little guidance. Performance information will be 
articulated. There will be coherence among assessed grade levels. 
There will be relationships between information secured to assess 
system capacity and system performance. Inappropriate uses of the 
assessments snould be avoided. 

• It is developmental. We understand it will evolve and change. We 
will avoid practices that prematurely freeze new assessments. 

• It is empirical. We will invest increasing reliance on its results as we 
develop experience and evidence of its validity, reliability, and 
fairness for each use and the? consequences flowing from each use. 

• It will begin with assessing content knowledge because that is what 
is technically the most feasible. However, there must be the 
understanding that students do not learn if they are not interested 
in the subject matlei . Thus, direct assessments of student 
motivation to learn need to be developed to supplement assessment 
of knovvledge. 

^ Because of this experimental nature, we want to monitor the impact 
of the assessments v:>n th^ ecUicational syj^tem. If we are in error, we 
are committed to changing our policies. 

• The assessment system will be practical anu economical. It will 
collect as much information as is needed with minimal disruption of 
instructional time for valid decisions but no more. 



Overall Requirements for an Assessment System to 
Assess the National Standards 

The new assessment system must be designed to ensure that states 
and local fiistricts have the primaiy responsibilities for creatuig and 
Implementing ass(*ssnH>nts for the purposes of accountability, school 
evaluation, student cer. .cation, reporting to j)arents, and 
instructional improvement. Such responsibilities should he state and 
local be(!ause derisions about schooling are made primarily at tlu^ 
state and local levels. Furthennore, there is no single best method of 
assessment. We nv.vA to provide for the creative development of 
multiple alternativ(?s lo assess the national standards. 

The responsibility for assuring the quality of these assessnunits 
would reside at the national level. The national level would also be 
responsible for monitoring progress toward the National Goals (this 
responsibility would be fulfilled by using NAEP, as it is modified to 
reflect emerging national content standards), additional national 
responsibilities are independently evaluating the impact of th(^ 
assessment system on the Nation s educational quality and equity, 
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and providing resourcCvS for technical assistance, research, and 
development on assessment so that the system may be improved. 



State and Local Responsibilities 

States or groups of states have the responsibility to devise 
differentiated assessments of the national standards. They may use 
these different assessments ultimately for purposes of monitoring 
progress, accountability, student certification, instructional 
improvement, or school evaluation. For a state to participate in the 
system to assess national standards, its assessments must meet 
certain assessment quality standards. 

States are to be encouraged to explore wide options in how they 
approach the design of assessments of the content standards. They 
are encouraged to develop innovative schedules of administration and 
improved procedures to report to their publics. There will be many 
legitimate strategies adopted by states to reach the content 
standards. Consequently, it is expected that there v/ill be diverse 
interpretations of these standards in currculum and teaching 
practices. This diversity is to be encouraged and is a welcome part of 
our Nation s educational heritage. But all assessments used as part of 
the national standards process must be developed to reasonable levels 
of validity and fairness. 



National Responsibilities 

There are four responsibilities at the national level: 

1) Assuring quality of assessments 

2) Monitoring progress toward Goal 3 of the National Education 
Goals 

3) hidependent studies of the impact of the assessment system 

4) Technical assistance, development, and research 

Assunng Quality of Assessments 

Assessments must be judged to be consistent with the national 
standards and to meet criteria of validity, reliability, and fairness. 
Without this quality assurai^ce at a national level, we have no way of 
developing a truly national system. Quality standards for the 
development and use of assessments will be developed and adopted 
by a nationally authorized entity. 

Quality standards for the development and use of assessment will 
be developed and adopted by a imtional ei^tity. These quality 
standards will be adapted as appropriate from the Standards for 
Educational and Psychological Testing (American Educational 
Research Association, American Psychological Association, National 
Coun"-' m Measurement in Education, 1985) and will also include the 
eigh .eria articulated in the Criteria for Evaluation ofStiidfmt 
Assessment Syste7ns (National Forum on Assessment, 1991), Such 
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quality standards, incorporated in promulgated guidelines, should be 
helpful to states and local districts in the development of assessments. 

Two principal concerns are to be addressed by this entity: 
standards of assessment validity and standards of assessment equity. 

Standards of Assessment Validity 

For assessments to be valid, they minimally must assess the 
developed content standards. The entity will assure that the 
assessments proposed by states or groups of states are aligned with 
tlie national content standards. 

If high-stakes uses of assessment are desired, voiunteering states 
will provide empirical evidence of the validity of their assessments. 
The entity will review the validity studies to determine if they provide 
reasonable evidence to support the adoption of such high-stakes uses 
of assessment. This review and recommendation is necessary but not 
sufficient for high-stakes use of the results of the assessments. 

The entity will create guidelines and conduct studies to determine 
the comparability of assessments from different states or groups of 
states. At the outset, guidelines will be promulgated and reviews will 
relate to the comparability of assessment design, for example, in 
content quality, challenge to students, and content coverage. As 
available, empirical studies will be conducted to audit the operational 
comparability of assessments, standardization of administration, and 
to report publicly on comparability for given standards. 

Standards of Assessment Equity 

States will come forward with their plans for assuring equity in 
assessment design, administration, and use for gender, for special 
populations, disadvantaged students, and LEP students for review by 
this entity. 

There are three principal concerns regarding equity in assessment 
of LEP and other student populations: 

• If students are not assessed because of the lack of instnunents, they 
will fail to benefit from the presumed desirable effects of assessment 
(improved instruction, accountability, and targeting of resources). 

• If LEP students are assessed in English on subject matters such as 
mathematics, their performance will be handicapped to varying 
degrees by their English skills. The problem is not easily resolved 
even by assessment through the native language because of the 
heterogeneity of students and instructional programs for LEP 
students. Special procedures will need to be developed to take 
language and culture into consideration for appropriate assessment. 

• All students must be provided opportunity to learn. 

The entity will design in consultation with state and local educators 
guidelines for the collection of evidence on system and school 
capacity indicators, with specific attention to equity protection. 
Decisions will be made niated to the differential need for capacity 
indicators for different assessment purposes. States will provide such 
evidence as it becomes available. When evidence of both capacity 
indicators and validity standards is adequate, the entity will support 
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the use of high-stakes assessment with secondary school students. It 
is anticipated that the entity will conduct audit studies, visiting 
samples of schools, to verify the capacity and equity evidence 
provided by states. 

Rationale for Assessment Quality Assurance Function 

Our assessment system must acconunodate to the realities of state 
^nd local responsibility for education. The entity provides a 
technically responsible mechanism for assuring that the assessments 
are national, and are reasonable interpretations of the standards. 
Creativity and flexibility of assessments shoul^J be encouraged. 

Validity evidence for promising new assessments is not fully 
available and all agree that such evidence must await the design and 
preliminary use of assessments of the national standards. It is 
impossible to examine the validity, reliability, and fairness of 
assessments not as yet produced, but we must responsibly give notice 
that high standards of assessment will be expected. The national 
function of assuring the quality of assessments provides this notice. 

The entity will assist state or other entities and assist in the 
preparation of evidence on validity, reliability, fairness, and attention 
to the needs of special populations of proposed assessments. Validity 
evidenr:e will be pro^/ided for the specific use to be made of the 
assessment in view of the populations assessed. 

Evidence on the quality of system and school capacity indicators 
will be needed for a number of reasons: l)to assure quality and 
comparability of information; 2)to permit reasonable inferences about 
the operation of the education system nationally; 3)to be used to 
avoid unintended narrowing of curricula; 4)to provide critical 
information on opportunity to learn, tre^atment of special populations, 
and the avoidance of misuse of assessment before high -stakes 
assessment is recommended. 

Audit or verification through selected school visits is required so 
that: l)undue process information is not required of local districts and 
states; 2) the guidelines for evidence do not inappropriately prescribe 
instru(!tional or other school or system processes; 3)information is 
generated to make the capacity assessment more effective and 
efficient; 4)special policy-relevant information can be obtained for use 
by the entity, the Standards Council, or ("ongress. School visits will be 
made by teams of skilled school practitioners. 

The membership of the entity will be primarily technical to fit with 
their charge. EJxperts in measurement, assessment, subject matter, 
learning, classroom processes, and special populations will comprise 
the entity. 

Monitoring System Progress Toword Goal 3 of the National 
Education Goals 

A critical national responsibility is monitoring progress toward the 
National Education (Joals. The* most effeu^tive and efficient method of 
monitoring progress toward (Joal 3 is the National Asse^ssment of 
Educational Progress (NAEP). NAEP. with the oversight of the 
National Assessment Governing Board (NAGB), should continue in its 
present role. Although development and refinement is necessary for 
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NAEP to assess the content standards, NAEP is well designe^d for 
meetinj? this monitoring function for the Nation and the states. A 
broad-based NAEP that provides conii)rehensive assessments of 
important subject matter areas is needed to provide independent 
information about our educational progress. NAEP has a critical role 
to play in meeting the national responsibility of monitoring progress. 

Rationale for an independent NAEP. The monitoring function of 
NAEP must be preserved and kept separate from the newly 
redesigned assessment process so as to remain a source of 
independent evidence on the progress our Nation is making toward 
attaining its Goals, hnportantly, as NAGB has recently noted, NAEP 
serves as a general check on the trends of educational progn^ss, 
trends that may not be available from any other source. NAGB must 
continue to give its full attention to the development and 
improvement of NAEP to meet simultaneously the need for progress 
information and the need to adapt as appropriate to the national 
standards. 

Independent Evaluation of the Impact of the Assessment System 

The Assessment Task Force considers it essential that indc^pendent 
evaluations of the effects of any national assessment system be 
conducted on a continuing basis. These evaluations should be the 
responsibility of one or more organizations that are independent of 
those that establish the national staiidards or develop or approve the 
assessments used in the national assessment .system. As a check on 
the system, the evaluations should examine several different aspects 
of the assessments. They may investigate independently the reliability 
and validity of the examinations for specific uses. They should 
evahiate the fairness of the examinations for various groups of 
students, hi addition, the evaluations .should explore the impact of the 
assessments on learning and the overall quality of the educational 
system. These studies should have a national focus and have^ as 
primary audiences the public, Congress, the Secretary of Education, 
and the National Education Goals Panel. Evaluations might determine 
if assessments have had positive impact on the opportunity of 
students, the quality of instruction, or the confidence of the public in 
the quality of students' accomi)lishnients. Studies may address 
negative impact of assessment on equity concerns, curriculum and 
teaching practices, and on student op})ortunity to learn. 

Technical Assistance, Development, and Research 

To assess the National Educ^ation Goals, we need ''break-th(^-nu)ld" 
a.ssessments. If we don't have tb.em, a nagging conceTU is that 
innovation will recede^ to the h^vel of less creative* assessments uscmI, 
We will need a bold and significant program to de^velop new tyi)es of 
assessnients and wish to involve talent from a variety of source^s. 
Substantial Federal financial support should be made* available to 
states and local districts, working in i)artnership with commercial tevsl 
publishers, universities and other cHlucational institutions, to dev(*lop 
new assessments that can fiilfill the vision of a positive assessment 
role in educational refonu. 
An additional national function is to provide technical assistance* to 
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states, local school districts, and their teachers to help them profit 
from the planned value of the assessment system. Specifically, 
technical assistance must be supported for the design, 
implementation, staff development, and reporting requirements for 
new assessments. 

Finally, a research program should be supported to help solve 
problems in design, analysis, and interpretation of new assessments. 
Areas requiring research will include, among others, new approaches 
to comparability, generalizability and fairness of assessments, 
adaptation of assessments to special needs of students, and issues of 
aggregation and reporting. 

All of these functions could be carried out by the United States 
Department of Education, 

Summary on Desirability 

Validity, reliability, and equity standards must be built in to any 
adopted national system. Because we do not have the standards and 
assessments in front of us to review, we have to create a process to 
safeguard their quality, A voluntary system of assessment is desirable 
if the system respects state and local control of education and assures 
the validity, reliability, and fairness of the assessments. 

Recommendations: 

• The NAEP should be the mechanism on a matrix-sampled basis to 
monitor our national progress toward the national standards. 

• A national examination system, or system of assessments, based 
substantially on assessments of the standards by individual states or 
groups of states, is desirable under certain conditions. Specifically, 
such assessments should be used for instructional improvement 
purposes until evidence* of their validity for high-stakes purposes is 
obtained, 

• An independent quality assurance "entity'* should be created to 
review the validity, reliability, and fairness of assessments in the 
new system. For high-stakes uses, volunteering states will provide 
evidence of their own choice of the validity and fairness of the 
assessment for the purpose iiitended. 

• A long-term, independent study should be conducted of the impact 
of any national system of assessment on tht^ quality of education, 
student accomplishments, and educational equity in the United 
States. 

Feasibility 

Feasibility of the assessment system hinges on a variety of factors: 
enabling conditions, incentives, and costs. 

Enabling CoiKlirians 

Three enabling conditions are required: the development of 
standards, the technical know-how to develop such assessments and 
the infrastructure to support such assessments, including concerns of 
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practicality and logistics. 

The development of standards is essential so that early 
development of appropriate assessments can begin. The development 
of curriculum is necessary so that assessments can be appropriately 
integrated into the instructional sequence and so that ^^opportunity to 
learn indicators" can be developed and implemented. Whether 
curricula or assessments need be developed first is a matter of 
contention and best left up to individual and groups of states to 
decide. 

Wliat is our technical knowledge base to develop valid new 
assessments? On the one hand, we cannot answer the question 
literally until we see the standards emerging from consensual subject 
matter processes. On the other hand, we have a robust and busy 
community developing and exploring the properties of new 
assessments. Many are using similar measures to focus learning, to 
reform the curriculum, and to improve teaching right now. Because 
we have proposed a developmental process that will reduce the 
likelihood of premature use of such measures for high-stakes 
purposes, the feasibility of the system on technical grounds is 
reasonable, particularly if recommendations are adopted to improve 
the development, research, and technical assistance bases. 

Logistical concerns are many and include a wide range of topics, 
from making sure teachers understand how administration and 
scoring techniques relate to instruction to classroom management 
techniques to allow valid assessment to occur. The practicality of 
early efforts will need to be examined objectively to avoid negative 
side effects of a nev/ assessment system. 

Incentives 

What incentives for participation in assessment development and 
implementation must be created? An obvious choice is to provide 
relief from certain Federal and state testing requirements. Logically, 
we can not imagine siinply layering on more assessment to that which 
is already in place. For example, relief from existing testing 
requirements could come in the form of encouraging the substitution 
of new assessments of the standards, perhaps performance 
assessments or indicators of capacity, for current requirements. 
Th(\se options would serve to free up staff and other resources for 
engagement in the design of new assessments. "Break-the-mold" 
a.,s^ssment development funds could provide a desirable jump-start 
to the process. Other options would allow commercial publishers of 
assessment to deduct their rest^arch and development costs to permit 
their investment in new assessment strategies. We suggest that 
decisions about incentives should be an t?arly agenda item for 
deliberation by any successor group to the Council. 

Costs 

The proposed system will require fiscal resources as well as 
reallocaUon of the time of teachers and others. By any rough estimate 
the system will be expensive. Costs will depei\d upon frequency of 
assessment tasks, whether scoring is internal o! extcM'nal to the 
school. Examinations can cost $65 a student for externally 
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administered, multiply scored efforts down to only a few dollars a 
student. We are estimating grossly we have about 10 million children 
to be tested annually, if each student were individually measured. Our 
cost estimates vary directly with the complexity of the effort. 
Sampling students could vastly reduce costs. P^urthermore, the cost of 
the operation of an entity with an audit or school function is 
considerable. Rough estimates, based on the Inspectorate system in 
Great Britain, suggest that costs per school visit range around 
$25,000. Even if contained by economies of sampling and scheduling, 
these costs are massive. Furthermore, studies of national im.pact, 
technical assistance, and research and development require 
considerable resources. We would hope the **break-the-mold" 
assessments would be funded at a level comparable to other major 
elements of the education reform effort. We are very much in need of 
credible estimates to be even in the ball park and request that the 
Council to seek assistance from an entity such as the Congressional 
Budget Office or findings, if available, from the Office of Teehnology^ 
Assessment svudy on testing to assist in the accurate estimate of costs 
for the development and operation of the national and state 
components. But we can assure the Council it will take considerable 
resources to fulfill the vision. 

Who Pays for U? 

State and local governments are not able to support new assessnuvit 
costs at the same time state economies are in trouble. It is hard to 
justify costs of assessment as instructional resources constrict. Even if 
participants in this asst^ssment system were given relief by the 
Federal and state governments from certain student testing 
requirements, the funds generated would be relatively small against 
the need. But we need to find resources for the support of desirable 
new assessments meeting the standards. Support is essential by the 
Federal Government for the development of "break-the-mold" 
assessments by states or groups of states to m(»et the national 
standards. The private sector may be helpful, i)articularly foundations 
and businesses with interests in improving schools. But their 
discretionary resources are incr(^asingly limitiKi. 

We may also be naive at this tiitie to believe that a complex 
development proc^ess such as we are proposing has to start on all 
fronts for every child inunediately. We may iu)t be able to pay tlu^ full 
bill right now, and we nuiy want to pay as we go. States luay very well 
have to size their efforts to Ihv. pocket book available and pick 
particular subject matters on which to concentrate. Similarly, they 
might focus atteiaion on particular localities or districts to permit the 
process to go forward in the current economic enviroiunent . 

Similarly, it would be essential to obtain in written testimony 
opinions of states on the finaiu^ial trade-offs and their estimated costs 
to meet quality assurance standards. 

Recommendation: 

The Assessment Task Force believes it is feasible to develop a system 
to assess national standards on technical grounds if we adhere to the 
developmental principles underlying the proposed design i)articularly 
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the use of differentiated assessments for different * nrposes. The 
feasibility of system costs will depend upon what resources are made 
available by the Federal Government to initiate and sustain the 
process. The Council may ulsh to consider cost sensitive and resource 
leveraging schedules to encourage some activity to begin inmiediate^y. 

Implementation 

We propose taking our lead from the business community and to 
adopt an implementation strategy that rests on the idea of rapid 
prototyping — getting something, even something modest, into trials 
early, and adopting a test-and-fix approach — to improve our 
assessments as we go. Critical to this overall strategy are three points: 
coordinating development in a few priority areas, for example 
mathematics, reading, and writing, for fourth grade; encouraging 
different strategies and approaches; and reporting descriptive 
information as early as possible to the public, parents, policymakers, 
educators, and students. 

First Steps Recommended to the Council: 

• Encourage the development and trial of assessments of the NCTM 
standards. 

• Make governance decisions, and seek authorization and funding for 
the National Quality Assurance function. 

• Encourage the funding of research projects and new *1)reak-the- 
mold" assessments. 

• Move toward encouraging the relief of (certain existing Fed(M*al and 
state testing requirements for participants in the national standards 
process. 



Issues 

There arose in the Task P^orce discussions a number of issues that we 
wish to acknowledge briefly and bring to the ('ouncil's attention. They 
are not integrated into the body of the desirability and feasibility 
discussion because they may be regarded as beyond our charge. But 
we believe their consideration will ultimately impact the quality of any 
implemented assessment system. One major concern is the narrow 
focus on the five subject matters identified in the legislation. Wc are 
aware that the Goal 3 language is broader, and that the report in 
Education Covnts of the special indicators panel also recommends a 
broad based consideration of outcomes. Particularly of interest are 
outcomes that integrate across learning disciplines and that focus on 
skills that underlie many different kinds of performances. Attitudes, 
dispositions, and engagement are also important. One ol)vious area 
that is missing from our explicit consideration, although mentioned 
repeatedly in our discussion, is how to deal with the recommendations 
of the Department of Labor's commission on workforce skills 
(Secretaiy's Conunission on Aclueving Necessary Skills (SCANS)). 
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Expanding the foci for assessment is valuable because it provides 
choices to students of the areas in which they wish to focus. For 
instance, in many European countries students may choose among a 
variety of areas, including the arts, foreign languages, and somewhat 
more practical fields. Notwithstanding the cost constraints described 
above, we believe that a system that provides opportunity for students 
to emphasize at least in part their special talents and goals is the sort 
of system we should strive for. Clearly, this is a pyior matter for the 
consideration of the group charged with content star.dards. 

Discussions among the Task Force members also dealt with 
governance issues: who funds, manages, and insulates the quality 
assurance functions described. Different positions were strongly held, 
and we believe there are a range of arguments to be made on their 
behalf. 

A persistent concern was, of course, that even our minimalist 
system would be too costly or complex, and that the outcome and 
high-stakes features of the system would dominate the process. We 
believe that standards of validity, reliability and fairness, as well as 
concerns for special populations will not be served without the 
minimum components that we have proposed. 



Summary 

We recommend to the Council that they support the desirability of a 
system to assess the national standards as proposed. This system 
separates purposes of assessment, supports responsibility for design, 
development, implementation and public report mg of assessments at 
the state and local level, and provides for a set of essential national 
functions. State roles in this assessment system assure that 
appropriate traditions for the local responsibility for education will be 
observed. 

A major national function is quality assurance of the assessments. 
Quality is assured in terms of adherence to the national standards, 
and validity of assessments used for various purposes and student 
groups. Particularly important are the indicators of opportunity to 
learn, equity provisions for special populations, and the avoidance of 
the misuse of assessments. School visits to verify capacity evidence 
will be conducted on a sampling basis in the service of improving the 
process. The quality assurance function would also be responsible for 
developing reports on the comparability of measures developed by the 
various individual or groups of states. 

Another critical national function is the continuation of the 
independent role of NAEP as a mechanism to monitor national 
progress toward goals. Strong consensus exists to preseive the 
credibility of NAEP and the provision of trend infomiation as it moves 
toward assessment of the national standards. 

Similarly it is an essential national function to evaluate the effects of 
this proposed system. Our requirements provide that we immediately 
implement long-term studies of impact on the education system and 
on our students of any newly desi^ied assessment system. 

A program of "break-the-mold'* assessments is proposed to provide 
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additional momentuin to the system plan in order to improve its 
chances of success. 

Finally, programs to provide needed technical assistance and 
continued research to address emerging technical problems should be 
supported 

The Task Force considered feasibility and believes that the system 
is feasible technically if developmental and validity principles are 
upheld in the quality assurance process. The Council needs reliable 
cost figures for the development and operation of the assessment 
system. Particularly, early steps were suggested to get this system 
launched immediately. 
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Report of the 
Implementation 
Task Force 



T 

A he National Council on P]ducation Standards and Testing was 
established to provide advice regarding the desirability and feasibility 
of national standards, a national examination system, and related 
issues. Uiideiiying the interest in standards and assessment is deep 
concern arising from persistent evidence that the ac:ademic prowess 
of American student s is seriously deficient. This deficiency touches all 
student groups regardless of income, race, language, gender, or 
disability. Thus, Congress is interested in high standards and rich 
assessment strategies for all students. At thc^ same time, a number of 
questions posed by the Congress to the ('ouiu il concerning "wide 
variations in resources available to school systems," the special 
challenge of success posed by "economically disadvantaged childreii, 
handicapped children, and children with limited English proficiency," 
the use of national examinations "for unintended purposes (such as 
sorting and tracking of students)," and "whether... it is feasible... to 
challenge all children to do their best without penalizing those of 
lesser educational opportunity" make it clear that equity is a central 
issue to the Congress. The Task Force shares that equity concern. 

Neither the Congress nor the Council is interested in simply 
creating higher standards and new tests so that the Nation ('an know 
one more tin\e that our students penorm poorly. Significant 
improvement in perforn\ai\ce by all students, including those with 
whom we historically fail, is the objective. The Council is clear that 
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simply creating higher standards and new tests will not result in 
significant improvement. The Implementation Task Force was created 
by the Council to offer advice to the Council as to what must be done 
to ensure that most students are able to demonstrate on the rich new 
assessment strategies they know and can do what the new higher 
standards will call for. Absent leadership in helping students achieve, 
the standards and assessments, as the Standards Task Force has said, 
will be a cruel hoax. 

Our report"^, therefore, is based on the following assumptions: (l)all 
students can learn at significantly higher levels; (2)academic 
achievement must increase dramatically in English, mathematics, 
science, history, and geography if the Nation is to maintain its 
economic strength and democratic institutions; (3)increases in 
achievement must be demonstrated by youngsters with whom we 
historically fail — the poor, disabled, and language minority — as well 
as with students with whom we have been relatively more successful; 
(4)marginal changes in schools of the reform character practiced for 
the past decade will continue to yield mediocre results with virtually 
all students; (5)there are many reports of potentially promising 
practices, but there is little knowledge about how to be successful 
with students on a large scale; (6)we should rethink how present 
funds are being invested in education and not hesitate to incorporate 
more cost effective practices when appropriate; and (7)substantial 
additional resources will be necessary, but "raore of the same*' is not 
enough. Any increased spending must purchase measurably 
productive change. 

These assumptions lead us to the conclusion that only deep and 
systemic change will have the power to alter school, district, state, 
and community behavior sufficiently for virtually all students to meet 
the new standards the Nation requires. The depth and breadth of 
necessary change will involve a number of integrated parts. The 
integrated and comprehensive character of what we propose cannot 
be overemphasized. Thf piecemeal, project-oriented, narrowly 
focused mentality that has affected much of the largely failed reform 
measures to date must give way to broader strategies that are 
connected vertically (school, district, state. Nation) and horizontally 
(within a school, district, state. Nation). The Congress called on the 
Council to determine the desirability of national standards and 
assessments. National standards and assessments are not desirable 
without comprehensive initiatives such as those suggested below. 

High standards and assessment strategies rich enough to measure 
the extent to which students have met them are oar reference points. 
By high standards, we have in mind the knowledge, understanding, 
and application of complex facts and processes; the ability to 
conceive, infer, and deduce ideas and reach conclusions; the capacity 



7. Throe ducumcnts niadr a special contribution to our thinkin^Ji. They are: ( 1 ) Educating 
Aruehca, a report from the NGA tliat Identified iinplementatioi] activities they thought would 
he important to achieve the national goals; (2) "Systemic Schoo' Heform" {Politics of 
Education Association Yearbook 1990, 233-267), a paper by Marshall S. Smith and Jennifer 
O'Day, setting forth elements of systemic efforts underu'ay across the country and tfuiughts 
about the key factors that must be addressed; and (3) TheEssrvtial OmnKmmis of a 
Succossfid Education System, which is the public policy agenda of The Business 
Roundtable. 
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to communicate effectively; and the skill to work productively with 
others. We believe such knowledge and capacity to perform will be 
reflected in the full range of disciplines embodied in the humanities, 
mathematics, and sciences. Rich assessment strategies are those that 
can measure the type of standards reflected in those examples. They 
will likely include portfolios, projects, and performance-based 
strategies. Some will involve individuals demonstrating competence at 
a particular point in time. Others may involve activities performed by 
groups of students over a period of time. We have paused to describe • 
the character of standards and assessment that governed our tliinking 
to make the point that we believe it is those kinds of standards and 
assessment that are desirable if schools, districts, states and the 
Nation provide the support that will enable students to meet the 
standards. 

The equitable implementation of high standards and rich 
assessment strategies depends on well-prepared teachers and 
administrators, equipped with proper tools. The tools include 
curriculum resources, instructional approaches, and technologies that 
will enable children of diverse backgrounds and interests to achieve 
the national standards. Teachers and administrators need the support 
of governance systems that are efficient and helpful, not top-heavy 
and inhibiting. They must be provided strong support from the non- 
school community. They must function within a system that places a 
premium on student outcomes and professional practice. Since 
students spend far more of their lives out of school than inside, 
achievement of standards will depei.i on building of communities of 
and for children and parents that support the health and well-being of 
youngsters that are a precondition of learning. 

We will, therefore, discuss implementation within eight broad 
categories: 

• Curriculum resources and instructional strategies 

• Incentives 

• Governance system 

• Staff capacity 

• Support systems for students and their families 

• Technology 

• Public understainiing and support 

• Equity 



Curriculum Resources and Instructional Strategies 

Curriculum resources and instructional strategies need not (inc^eed, 
should not) be separate from assessment as routinely as is presently 
the case. The lines between instruction and assessment must be 
blurred both from the curriculum and the assessment perspective. We 
advocate assessment strategies that will make "teaching to the test'' 
desirable. It should also be noted that for curriculum and instructional 
strategies to make sense to teachers, the teachers must be engaged in 
both developing curriculum frameworks and in identifying the 
characteristics that distinguish resources and strategies likely to help 
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students achieve the national standards from those that will not. 
While we address the development of staff capacity below, we note 
here that opportunity for teachers to work mth and develop 
curriculum on site will play a very important role in a staff having the 
ability to teach effectively. 

The definition of national standards must include the crafting of 
state curriculum frameworks. Such frameworks will make clear that 
we must abandon the minimmn skill orientation, the emphasis on 
coverage not depth of understanding, and the premium that is often 
placed on students knowing isolated facts. Instead, the curriculum 
frameworks will be discipline-based, oriented toward thinking, 
understanding, problem solving, and knowledge integration with 
connections to the real world. Such frameworks should provic^e 
parameters, not prescriptions, for practice. It is necessaiy to provide 
the school staff with access to the tools of teaching and learning, the 
curriculum resources, and the capacity to identify or develop good 
instruction strategies, including interactive technologies. 

For curriculum materials and strategies to be outstanding, they 
must be linked to the standards and assessment strategies on which 
the Council is focused. A process must be put in motion to develop 
charact eristics of curriculum resources and instructional strategies 
likely to help all students achieve the national standards, without it 
resulting in a one-size-fits-all mentality. Examples might include: (a)- 
the depth of the material; (b)the richness of recommended class 
exercises; and (c)how much emphasis is placed on student dialogue, 
cooperative learning, and v^iting. We believe this process should also 
include the next step of having an appropriate authority actually 
review curriculum material and other instructional resources against 
the characteristics. The appropriate authority could be the state or, 
perhaps, a consortium of states and cities, working with professional 
and diycipline-based associations from which the standards and 
assessment strategies may emerge. It is important that this review 
process be rigorous. Absent special attention to rigor, it would likely 
result in the lowest common denominator of cu riculum material in an 
effort to minimize controversy and incn;ase sal' S. A process for 
extending a meaningful "(lood Housekeeping Seal" to assist in the 
voluntary identification and adoption of good practice would then be 
possible. To avoid the image that good practices are readily 
transportable across very different contexts, the "SeaF* process could 
be accompanied by carefully documented rc ports of practices tlmt 
were apparently successful (or problematic) in specific settings. 



Incentives 

A key component of any outcome-driven systemic change strategy is 
tliat consequences must be attached to the performance of staff in the 
schools and at the district level and to the i)erformance of students. 
Intrinsic factors play an extremely important role in motivating 
I)eople. The sense of ''a job well done" or the satisfaction of helping a 
student achieve extraordinary goals or another student to turn his life 
around are the types of factors that lead most educators to teach in 
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the first place. Moreover, good working conditions, district and 
coninninity support, and acknowledgment of good effort are also 
significant. But it is clear that extrinsic factors also play a role in 
shaping how and how hard people work — staff and students alike. 
While incentives, positive and negative, are not sufficient to move the 
system — high standards, rich assessment, changes in governance, 
professional development, health and social sei-vice support, 
technology, and more time for teachers and at least some students are 
also necessary — incentives are an essential component. 

Staff of Schools and Districts 

hi designing a strong incentive system for schools or school districts, 
there are a number of principles we believe deserve consideration. 

Incentives need to be tied directly to achievement of high standards 
related to both student outcomes and professional practice. We 
contrast this mih the widespread present practice of encouraging 
focus almost exclusively on inputs (filling out forms) and low-level 
skills (minimum competency tests). 

Incentives for school and district staff need to be powerful enough 
to rivet staff attention on the achievement of the high standards. 

Incentives should place a premium on doing better with students 
with whom we presently do the poorest job as well as those with 
whom we do the best. It is very important that we have learning 
environments in which all students dramatically move up the 
achievement continuum from where they presently are. We contrast 
this with present incentive systems, for example, that encourage 
experienced teachers to work with the least challenging students or 
lead to "pushing out" the most challenging students or to (Micourage 
the absence of the poorest students on days assessment is to occur or 
to retain in grade the most difficult youngsters. 

Incentives should be designed to reward value added by a school 
over a defined period of time. We contrast tliis with focusing on inter- 
school compansf)ns, which tend to measure demographic 
characteristics more than the difference a school is making in the 
achievement of students. 

Incentive systems should be designed so that students are not 
harmed. For example, if penalties are a part of the incentive system, 
financial penalties or even dismissal for persistently failing .staff, at the 
district and school level may be appropriate but not the withdrawal of 
funds for the school program itself, Indeed, it may be appropriate for 
such schools to have more program funds, not less. 

There should be a spectrum of inccnitives. The positive end should 
include such things as financial rewards for staff at both the district 
and school levels, opportunities to participate in special profe^ssional 
develofiment, and recognition programs. Schools experiencing 
difficulty should be assisted through technical assistance, extra 
professional development and special funding. Staff in schools and 
school districts persistently failing could face penalties including 
public disclosure, loss of students, staff financial loss, dismissal of staff 
and school reorganization. 

There is no one best way to fle\sign an inciMitivt^ system. Moreov(M\ a 
single approach will likely not work forever. Incentives are situational 
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and can be tricky to implement without causing unintended results. 
These words of caution are intended to encourage thoughtfulness and 
sophistication in the design of the system, recognizing that an over- 
simplistic or crude system rooted in a punishment focus would be 
counter p roduc ti ve . 

Students 

There are a number of considerations related to providing incentives 
for students to work harder. They include: 

• At the present time, except for those applying to the most 
competitive four-year colleges in the United States, most high- 
school graduates are admitted to the college of their choice. Thus, 
most students know there is not much "pay off related to higher 
education for outstanding performance. Systems of collaboration 
with post secondary education institutions of all kinds should be 
designed to make clear to students that elementary/secondary 
performance influences post-secondary education opportunities. 

• Quality alternatives to college for the "forgotten half," such as 
apprenticeship programs, which also require strong entiy skills, 
need to be developed in partnership with the business and labor 
communities. 

• Systems of collaboration with employers should be designed to 
make clear to students that elementary/secondary performance 
influences hiring decisions. In designing the systems, special care 
must be taken to prevent such standards from being used in a 
fashion that would result in undesirable behavior such as racial 
discrimination. 

• A variety of incentives short of jobs and post-secondary 
training/education opportunities that encourage hard work by 
students should be considered. They could, of course, include 
traditional factors such as grades. In addition, students could be 
given greater choice of learning opportunities, choice of projects, 
working in groups, etc. 

• High stakes for students should follow high stakes for schools. If we 
have high standards, rigorously maintained, we must give schools 
time to learn to succeed with increasing proportions of students 
school-wide before we penalize individual students. Otherwise, 
students will again bear the full brunt of the system's failure. 



Governance system 

We believe the systemic change that is necessary to have all 
youngsters achieve the new high standards will involve new roles and 
relationships for the participants. Principles that govern these new 
roles and relationships should include the following. 

• In the exercise of power, authority and responsibility should be held 
in i)arallel. If more responsibility for student performance is moved 
down the bureaucratic pipeline, more authority and the resources 
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associated with that authority should follow or vice versa. Power and 
authority should be exercised as close to the individual student as is 
consistent with effective accountability. 

• Each level of government should examine its standards and 
regulations in order to remove any that are or are perceived to be an 
impediment tc appropriate decisions at lower levels. 

• Legislative bodies (including Congress, state legislatures, state 
boards of education, municipal legislative bodies and school boards) 
and non-educator executives (including the President, governors, 
and mayors) should be decisively involved in goal and curriculum 
standards determination (outcome definition), policy decisions 
related to the nature of assessments, a determination of 
consequences to be attached to student outcome performance, and 
the provision of adequate and equitably distributed resources. 
Education management and school-based personnel should then be 
given the freedom to get the job done witliin a period of time that 
has been agreed upon. 

• Each level of government should address the adequacy and 
equitable distribution of resources in levels below it to ensure at 
least equity of opportunity of all students to reach the high 
standards we envision. For the federal government, for example, 
that means attention to initiatives such a ESEA Chapter I, Head 
Start, and Education for the Handicapped Act. For states and 
districts, this principle includes elimination of the present 
widespread fiscal inadequacy and inequity between districts and, 
within districts, between schools. 

• The governance structure should be a function of what works. 
Radically different models of governance are possible in the public 
sector. For example, charter schools; charter districts operated 
within a public utility concept; school-based shared decision- 
making; boards of children and families that collapse distinctions 
among education, health, and social service agencies; and children's 
welfare boards are among governance proposals that have been 
made in the hope of contributing to higher achievement of ' udents. 



Staff Capacity 

This area is extraordinarily important. We are asking schools to 
accomplish levels of achievement that have never been accomplished. 
We are asking that the diversity of students achieving at those high 
levels be broader than ever before. The nature of the expected 
learning for the majority of students — thinking, problem solving, 
integration of knowledge, working in teams — is different. The nature 
of assessment will be different. The locus of decision-making will be 
different. Pedagogy, with greater reliance on strategies such as 
dialogue, writing, and community based experiences, will be different. 
The tools of teaching and learning technology will be different, hi 
short, a radically different kind of teaching will be required of most 
teachers. To do what must be done will require time for staff and 
exceptionally hard intellectual work. With changes so wide and deep, 
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the professional development of staff is central. The radically different 
behavior on many fronts will not occur by passing a law or issuing 
directives. Major changes will be required both before and after the 
commencement of service as teachers and administrators. 

Pre*Service Professional Development 

Pre-sei-vice education should be linked to the national standards and 
prepare teachers with the knowledge and skills to help diverse 
students to achieve the standards. But this is difficult. Pre-servico 
teacher education has undergone little change over the years. Present 
training in neither content nor in pedagogy is adequate. As teachers 
come into the profession, they require a broad and deep knowledge of 
their subject matter. This poses a particularly strong challenge to 
colleges of arts and sciences since it is there and not in colleges of 
education where content is most often addressed. This, for example, 
may require, for elementary teachers especially, a concentration in 
matli/science or humanities instead of the once-over-lightly approach 
to everything. While ultimate teaching competence will be honed in 
practice, strong pedagogical pre-service education is also important. If 
we are to change from a model of teacher as the worker and deliverer 
of knowledge with the students as passive receptacle to a model of 
teacher as coach and facilitator and student as worker, it will require 
very different pre-service preparation. 

If we are to have significantly better teachers entering the 
profession, it will likely involve strategies such as a rigorous and 
carefully developed performance-based assessment for entry lev(^l 
teachers based on standards directly linked to the national standards 
for students. All teachers, whether they enter teaching through a 
traditional or alt(irnate route, should be expected to meet high 
standards of subject matter knowledge and pedagogical skill. Change 
in pre-service preparation will be impeded unless accrediting bodies 
and prograni standard-setting institutions such as the National 
Council for the Accreditation of Teacher Education and t he National 
Association of State Directors of Teacher P^ducation change their 
standards to coordinate with the new national student standards. 
Their standards need to be made consistent with the teaching 
standards being developed by the National Board for Professional 
Teaching Standards (NBPTS). 

In-Service Human Resources Development 

Most of the teachers presently teaching were not trained to function 
with the new necessary capacities. Thc^y have not taught in sciiools 
where such behavior is exhibited. Th(^y have not had role models of 
such teaching to emulate. Ther^^ is no reason to expect most to have 
the capacities required to have all students wwci the new stamlards. 
Most of the preseiit teachers will be in the teaching force for a long 
time. Thus, a far-reaching in-service human resources developn\ent 
initiative is vital if we want students to achieve the i\ew standards. We 
underscore the following principles: 

• Effective professional devrlupniei\t nujst be defined specifically in 
relationship to what students need lo know or be able to do 
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(national standards). It needs to be sustained, intense, and targeted 
on both discipline-based and pedagogical content and on 
instructional tools such as technology related to the teacher*s job. In 
the private sector, when new corporate goals, products, or 
technologies are introduced, companies organize the time of 
workers so needed re-education and training can be pursued as part 
of the worker\s regular work responsibilities, whether the additional 
training occurs on-site or off-site. Similarly, when changes in 
teachers* responsibilities occur because of new educational goals, 
new forms of evaluation, new kinds of students, new curricula, or 
new technologies, professional development must be offered in the 
context of the teacher's job, not as an *'add-on'* on weekends or after 
school. 

• The best professional development will be done in school as, for 
e^xample, teachers work on curriculum development, create 
assessment tasks, and learn from their peers. Such activities should 
be undertaken purposefully as a structured effort to enhance 
professional capacity. As a corollary to such site-based w^ k, new 
models of human resources development such as teaching 
academies or other professional development school models should 
be encouraged. 

Determining what standards define what experienced teachers sfiould 
know and be able to do and developing the assessment strategies that 
permit us to know teachers have met the standards are important 
corollaric^s to setting student standards and assessment. The NBPTS 
has embarked on that critical and aml)itious effort related to 
experienced teachers and deserves strong support at all levels of 
government. Their work, of course, can also inform standard-setting 
of new teachers recommended above and standard-setting for 
students. 

The training and nurture of superintendents, principals, and oIIuts 
in leadership positions is important since they play such an important 
role in creating the climate within which learning takes phu^e (or 
doesn't). Thus, we need to focus on high-performance manageiiuMit 
qualities such as sharing power, focusing on the well-being of tlie 
student, being aware of community/consumer needs, opening lines of 
communication with staff and parents, and developing strong ties to 
other public and private non-profit support groups. 

Two final comments related to staff capacity must be made, f'irst, it 
is clear that wi} must have higher entrance standards into teaching. 
Standards for staying in must also be more rigorous. In short, it will be 
tougher to become and remain a teacher in a .system committed to 
high student achievement, Doing the job will also l)e much different, 
and maybe even harder, work. As a consecjuence, fundamental 
changes in compensation systems, work organizations, and in working 
conditions are required if we hope to attract and hold sufficient 
quantities of the quality of people we want teaching and 
administering. 

Second, the issues of adequacy and equitable* distribution of 
resources are particularly important in relationship to staff capacity. 
Additional time must be provided if professional development is to be 
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part of, not an add-on to, the teacher*s job. That costs money. In the 
districts in which low income, limited-English speaking, and disabled 
students are disproportionately concentrated, the resources issue as 
it relates to high standards for teachers and administrators, 
compensation, work organization, and working conditions is 
particularly critical. 
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Support Systems for Students and Their Families 

Education does not start in kindergarten or at the first grade, but 
much earlier. Educators are not a student's first or only teachers. 
Parents and others in the community fill those roles. Hungry, 
unhealthy, and homeless children are not going to learn to think 
critically, solve problems, or otherwise meet the high standards the 
Council has in mind. It has been estimated that more than 909^ of a 
student^s life occurs outside the school. Such facts make it clear that 
stroni^ leadership, courageous initiatives, and adequate resources 
directed toward the well being of students outside the schoolhouse 
door are necessary to achieve the standards to which we aspire inside 
the schoolhouse. There are at least three general areas in which action 
is important. 

Parents and Other Student Advocates 

Every child requires an advocate. The advocate of choice is the 
parent. There are several key connections between home and school: 

• Parents should support the high expectations reflected in the 
rigorous standards we anticipate for their children and create the 
environment at home that demonstrates the premium placed on 
education (e.g., control distractions such as video games, television, 
and radio; read to the child; do personal reading; and insist on school 
attendance). 

• Schools should appropriately integrate parents and other resources 
in the community into the education program itself, not simply use 
them around the edges in busy work. 

• Parent education is important. This includes helping young parents 
know how to parent. It also can mean the school strengthening the 
academic skills of the parent. All of this is directed toward helping 
the parent help the children. 

• Schools should communicate with parents, be responsive to them, 
and involve and work with them to ensure the child's success. 

• Many, and increasing numbers of, children do not have a fiinctioning 
parent or source of similar support. An alternative must be found in 
those circumstances. On the one hand, we can help strengthen the 
family and the parent's role in the child\s education. Still, when there 
is not an effective parent, that must not become the school's excuse 
fc failure. There are at least two g(M\eric alternative categories. One 
is what some call home-based guidance. In this context, one version 
is for all of the staff in a school to undertake some measure of e^tra 
oversight and concern for indi^/idual children. The other apprr 
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(not mutually exclusive) is to assure the support of a trained 
community-based role model (a mentor, big brother, big sister, etc.) 
for every youngster needing one. 

Early Childhood Educorion 

The evidence is very strong that a quality, developmentally 
appropriate pre-kindergarten program for disadvantaged students 
reduces significantly m.any of the problems associated with poverty. It 
contributes, therefore, to the degree to which low-income youngsters 
ultimately may achieve at high levels. We give emphasis to the 
importance of the program's quality and developmental 
appropriateness. 

Since such programs are less expensive and more effective for 
children than waiting to provide remediation to them when they are 
older, at least eveiy disadvantaged student should have the 
opportunity of participation. In order to assure the opportunity for all, 
it may be wise to consider providing for all and making it free for low 
income students. Such an approach would avoid the effort being 
perceived as a poverty program. It could also contribute to racial and 
economic integration. 

It is also clear that such early childhood programs are most effective 
when continuing support for the students is provided through 
elementary school to prevent backsliding. 

Health and Social Services 

Students whose most elemental shelter, food, and nurturing needs are 
not met are not going to perform at the minimum competency level 
consistently, much less demonstrate they meet world-class academic 
standards. The health and social service systems must be restructured 
to better meet the needs of the poor and the working poor. The 
coverage of demonstrably effective programs such as prenatal care; 
Women, Infants, and Children; Early Periodic Screening and 
Diagnostic Treatment; and the school breakfast and lunch programs 
must be expanded to cover all children in need. 

We recognize that most of the effort necessary to provide health 
and social seivice support to children and their families will not be 
provided by the education system. However, we include it as part of 
the necessary systems change in our report since it is (^lear that we 
will not achieve high national standards with a large proportion of 
American children, absent change in the other systems. Indeed it may 
be necessary at all levels of governnient to restructure the health and 
social service systems by employing the same principles we are 
suggesting for education; for example, identify appropriate outcomes 
(standards) for which the system will be accountable, develop any 
necessary assessment strategies, associate consequences for staff 
with the achievement of outcomes, provide the type of necessary 
training including cross-system training, alter governance and 
financing formulae to at least encourage if not force service 
integration, and provide resources such as adequate health insurance 
so that all children and families are covered. 
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Technology 



A much greater use of technologj^ will be vital to our goal of having all 
students achieve the new high standards in at least three ways. 

• Technology can enhance instruction when teachers use it as a tool. 
It permits students to structure complicated efforts. It can promote 
both the individualization of learning and working in teams. Since 
much higher level learning occurs best when it arises from "doing 
the learning" and since video and computer technologies can depict 
and/or simulate real life, there is much greater opportunity for 
authentic learning. Multiple technologies permit access to many 
more dimensions of experience arising from history or science or 
existence halfway around the globe. A resource-rich environment 
can be provided in any school anywhere through technology. In this 
context, the development of software powerfully aligned to the 
national standards is important. In addition, instruction-related 
assessment strategies may be powerfully enhanced by technology, 

• Technology enhances access in several ways. One is through 
distance learning. Students can connect to one another (student to 
student, countiy to country). Students can connect to sources and 
levels of knowledge otherwise unavailable (data bases, interactive 
courses led by scholars, educational television, etc.) Technology can 
bring to every teacher resources now available only to a pri^nleged 
few. Two-way video and audio technologies, for example, allow 
higher education faculty and elementary/secondaiy faculty to confer 
m ways that can facilitate training, use of resources, and access to 
research. The more teachers learn from one another and in ways 
directly connected to their school and classroom, the more powerful 
the learning experience, Technology can help make that happen. 

Another perspective on access relates to disabled youngsters. 
Some technologies make relatively esoteric contributions (providing 
a speechless child a voice with a voice synthesizer); other helpful 
technology is routine (off-the-shelf work processing for the learning 
disi/.bled child). 

• Technology is also important in managing data. It can schedule our 
buses. It can collect and organize student data to help teachers help 
students. It can reduce administrative overload and permit greater 
concentration of scarce resources at the school arid classroom level. 

If we are to use technok)gy in the rich ways suggested above, 
professional development is crucial. Absent an intense, substantive, 
sustained, targeted professional development effort that is task based, 
technology either will not be used or it will simply be used to reinforce 
present practices such as when it is devoted to drill and practice. 

If we are to realize the power of technology, we must enable every 
school and student to use tlie most sophisti(*ated technology available 
to any school and student. This is, of course, a major equity issue as 
we bring "America on Line" for all, including schools with a 
concentration of disadvantaged, disabled, and language minority 
students. 
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Public Understanding and Support 



Less than 25% of the electorate has children in school. There are 
increasingly more older Americans than young. Most citizens believe 
the schools in general are in bad shape but that their local school is in 
good shape. Colleges and employers think the school's product is 
poor, while the students and their parents think the students are 
doing pretty well. Most people, including many educators, do not 
really believe all students can learn. Many parents believe that 
somebody's child needs to know math and science, but not theirs 
since the parents functioned just fine without the knowledge. Many do 
not understand that failing children create "tough luck" for all of us, 
not just for the failing children. Many believe that the traditional 
methods of schooling, curriculum, modes of testing, etc., are "correct" 
since those traditional methods conform to their '^wn experience. 
Such facts pose a huge communications challenge. They must chanj^e 
if the necessaiy supportive environment is to be created within which 
all students will meet the new standards. 

We must be clear who has a stake in American children meeting 
high standards and precisely what the stake is. Parents, educators, the 
business community, the media, and elected officials must "buy in" to 
the new standards, new assessments, and initiatives of the kind 
addressed in this report if the climate is to exist to get the job done. It 
will be necessary to organize the message block by block, community 
by community; the print and electronic media must be used 
effectively; business, religious organizations, unions, and other 
institutions with regular access to large numbers of people — 
employees and members — must be engaged in the effort. 

In short, the attainment of high standards, as determined by rich 
assessments, is not the job of schools alone and will not be achieved 
by schools alone. A critical mass of the oitizeniy must understand the 
challenge and, in effect, insist that it be achieved. 



Equity 

Nothing we have said is worthwhile unless il is built in a manner that 
moves toward equitable results. Given our demography, the 
increasing proportions of students with whom we historically fail 
(about one third of all American students are poor, disabled, or do not 
speak English as a first language), and the economic and civic needs 
of the Nation, it has become improved results, not simply the 
availability of opportunity defined by input regulations, around which 
the Nation's future revolves. Providing genuine opportunity to all 
remains a moral imperative. Actually moving significantly toward 
achieving much higher results by each student than he/she presently 
exhibits is the Nation's econoniic imperative. The moral imperative 
has always confronted us. For the first time in American history, we 
face the economic imperative of greater equity in outcomes. 

Equity will require courage and uncommon action. Examples 
include fiscal equity (not just equality) within (and, perhaps 
ultimately, among) states. Another good example of effective action 
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could include major changes in Chapter 1 of the Elementary and 
Secondary Education Act when it is reauthorized in 1993 so it 
embraces the spirit of issues raised in this report (including the use of 
the national standards and assessments and full funding). 

We take tb' iportunity in this section to emphasize the 
recommendations in previous sections related to equity. Equity is not 
something that is, different from or stands outside other issues. It 
must be integral to every component of a successful education 
system. 

Conclusion 

It is important to note that the issues we raise are not issues simply 
considered seriatim. They are not a menu from which one picks and 
chooses. Systemic change is by definition comprehensive and 
integrated. There is a critical mass of change that must occur in the 
right order with adequate, equitably distributed resources to produce 
enough synergistic power to move the education system as far as it 
must move to produce the results on which the Nation's future will be 



built. 
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Appendix H 



Report of the 
English Task Force 



Background 

The English Task Force was created by the National Council on 
Education Standards and Testing to advise it on the desirability and 
feasibility of national standards for students in English and language 
arts. Other task forces were similarly created to advise the Council on 
standard-setting and assessment in five core subjects: English, 
mathematics, science, history, and geography. The English Task 
Force decided to rename itself the English/Language Arts Task Force 
in order to better reflect the broad range of skills commonly expected 
to be included in this subject (i.e., reading, writing, speaking, and 
listening). 

Status of Efforts to Develop Notional Standards in English 

There do not already exist nationally accepted standards in 
English/Language Arts for what should be taught, how it should be 
taught, or what students should know and be able to do. The National 
Assessment of Educational Progress (NAEP) has developed reading 
and writing curriculum frameworks through a national consensus 
process which are to be used in designing those parts of the 1994 
NAEP assessment. The National Council of Teachers of English 
(NCTE) is currently seeking funds to develop teaching standards, but 



The views expressed in this appendtt report reflect fJie work of 
this Task Force and are not necessarily those of the Council. 
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the effort is still in the planning stage. Several states, including 
California, Pennsylvania and others, have developed curriculum 
framev^orks for Englisti/Language Arts and are attempting to align 
their assessments accordingly. It is important that any national 
standard-setting process take into account these various important 
efforts. 

Are Nationol Standards Desirable, Given the Wide Range of 
Student Performance? 

National standards can do much to address those wide variations in 
student performance. They can help ensure access — for all children, 
regardless of race or background — to a high quality education in 
English/Language Arts. 

Of course, there is a potential for misuse of the standards as well as 
assessment results. The focus must be on improving education, not 
sorting and tracking students. Student performance should be viewed 
on a continuum leading to full subject mastery, mth students 
progressing at the pace that best suits them. Though the Task Force 
did not attempt to deal with the question of how second language 
learners will fit in with respect to Englishi/I^anguage Arts standards, it 
did agree that this issue is an important one that will eventually 
require careful attention. 

What Should Be the Process for Developing New Standards, 
and How Long Will It Take? 

The National Council of Teachers of English (NOTE) and the 
International Keading Association (IRA) are the major teacher 
professional groups in this area, and it is important that they be a part 
of the process. Development of standards in English/Language Arts, 
however, should also involve educators in other subjects or fields as 
well as interested lay persons, including business representatives, 
elected officials, and other policymakers. 

Content standards, performance standards, and teaching standards 
all need to be created. Content standards should be decided on first, 
beginning with what we want students to know and be able to do at 
grade 12 (the "product"), then working down through the early grades 
to establish reasonable benchmarks toward that goal. The content 
standards should be roughly the same at grades 4, 8, and 12, but the 
sophistication expected should increase at the upper levels. 
Performance standards and assessment should be developed in 
concert, based on the content standards. Examinations are likely to be 
ready in order of simplicity, with the earlier grades first. 

A small number of writers — about three — should actually draft 
the standards, and a broadly representative group numbering 
approximately two dozen should review their work. The broadei* 
group should meet at roughly one month intervals, providing input 
and advice on successive drafts. Assuming adequate resources 
(between $600,000 and $1,000,000) and committed personnel, this 
intensive process should last about six months. The resulting 
standards will require continued fine-tuning over time. 

Literature is the content specific to the Englisli/I^anguage Arts 
curriculum and enriches the life experience of all of us. All students— 
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regardless of race, gender, or background — should be able to 
recognize a wide variety of great works of literature (appropriate to 
their grade) and respond thoughtfully and knowledgeably given some 
choice of topic. The difficulty many students encounter today when 
they are first introduced to literature in the upper grades is a result of 
their often minimal exposure at the early and even middle grades; 
disadvantaged students are typically the ones most deprived of a rich 
curriculum. 

Teaching standards should also be developed to provide 
suggestions and examples to teachers on helping their students reach 
the new standards. Teachers should be free, however, to use their 
professional experience and discretion. 

Standards for the broader community, perhaps oven including the 
media, may be something worth considering as well. 

Assessing the New Standards 

It is important that students be able to demonstrate higher ord(?r 
competence in Englisli/Language Arts skills on a variety of topics. It is 
vital, therefore, that the standards developed for these skills in 
English/Language Arts inform those relevant aspects of assessment in 
other subjects. For example, grading of an essay on a topic in history 
should apply the appropriate criteria for writing skill as an essay 
analyzing a poem. 

The examination system should have a local component, such as 
portfolios or teacher evaluations, in addition to the national 
component. Experimentation should be encouraged in the local (or 
regional) section. 

The resulting examination system sliould not be yet an another 
"test" to which students are subjected; it should, instead, replace the 
outmoded standardized tests many students currently take. And it 
should be tightly aligned with exemplary classroom practices so that it 
validates superior teaching and learning. 

Meeting the New Standords 

Schools and teachers are not currently prepared for a challenging 
curriculum in English. Substantial attention to re-training of today s 
teachers will be required, well as a reexamination of pre-semce 
preparation for future teachers. Other systemic changes, as well as 
communities serious about the importance of schooling, will be 
necessary as well. 
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Report of the 
Mathematics Task Force 



Background 

The Task Force on Mathematics is one of eight task forces created by 
the National Council on Education Standards and Testing to advise it 
on mathematics standard-setting and assessment. The Council's 
charge is to report to the Congress, the President, and the American 
people on the desirability and feasibility of creating national standards 
in five core subjects (English, mathematics, science, history, and 
geography), as well as the desirability and feasibility of an 
examinations system to measure student progress toward the 
standards. 

Status of Efforts to Develop Notional Standards in Mathematics 

The Curriculum and Evaluation Standards Jor School 
Mathematics, by the National Council for Teachers of Mathematics 
(NCTM), should be accepted as appropriate **content standards" in 
mathematics. Though several states are in the process of developing 
performance standards and assessments in accordance with the 
NCTM Standards (such as California, Indiana, Texas, and Kentucky), 
these efforts have not so far resulted in a set of performance 
standards that are widely accepted as authoritative. (The 
Mathematics Task Force did not find the suggested distinction 
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between "achievement" and "perfonnance" standards a useful one, 
and this report only uses the term "performance standards".) 

Are Narionai Standards Desirable, Given the Wide Range of 
Student Performance? 

The creation of a single set of high-quality math standards for all 
students — and a national examination system to assess results — is 
vital in raising the overall poor level of mathematical understanding, 
and is especially important precisely because of the wide variations in 
student performance. Every student, regardless of race, gender or 
background, should be assured quality mathematics instruction in an 
atmosphere of high expectations for all. 

The standards should be created in light of the highest world 
standards, as well as our ovm judgement of what is important for 
students to know and be able to do. No compromises should be made 
to today^s low levels of performance. 

Though there should be one set of standards for all, we may wish to 
allow students to specialize in applying the standards to a particular 
area of interest. This option must be explored with care, to ensure 
that no student is limited b\ a "watered down" curriculum. 

To ensure equity, examinat , m results should be reported in 
conjunction with socio-economic information on those assessed 
(similar to the current reporting of NAEP scores). Assessment tasks 
will have to be carefully designed in order to be comprehensible to 
students from diverse cultural backgrounds. Arrangements should 
also be made to provide handicapped students a fair opportunity to 
succeed on the examinations. 

What Should Be the Process for Developing the New Standards, 
and How Long Will It lake? 

NCTM should play the key role in coordinating development of the 
standards. NCTM*s content standards will have to be elaborated for 
grades 4, 8, and 12. The development of meaningful performance 
standards and assessments requires a multi-phase approach. An 
iterative process should be employed, involving successive standards 
drafts and input at each stage from other mathematics professional 
groups, classroom teachers, and the public. The creation of sample 
assessment tasks is an integral part of the setting of performance 
standards and must be done in parallel. A variety of sample tasks will 
have to be developed covering every aspect of the standards. 

The full process of deve^loping performance standards and sample 
assessment tasks will take approximately one and one-half years, 
assuming adequate resources and personnel. The resulting product ~ 
though ready for use — should still only be viewed as a beginning, to 
be improved upon over time. 

Assessing the New Standards 

• The standards should provide information on varying degn^es of 
performance at grades 4, 8, and 12, each examination level. 

• Assessment must be aligned with the new standards and sound 
instructional practices. For example, if we believe that we should be 
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encouraging the development of extended mathematical reasoning 
and problem-solving, assessment must include complex tasks and 
ample time for thought. The importance of high quality assessments 
is further enhanced by the likelihood that high stakes incentives will 
be attached to performance on these measures. 

• Assessment should focus on mathematical tasks for which students 
can train and do well, not "brain teasers'' that require innate ability 
to perform successfully. 

• We may wish to consider separable score results in a variety of 
mathematical "domains" to more fully capture the range of student 
math ability; this requires careful consideration to determine what 
new "domains" would be useful, if any. 

• Assessment tasks should be v^Tltten in a way that is understandable 
to a broad audience and past examinations should be made available 
for public review. 
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Report of the 
Science Task Force 



Background 

The National Council on Education Standards and Testing was formed 
by the Congress and the President. The Council created five Task 
Forces in the core disciplines of English, mathematics, science, 
history, and geography plus three Task Forces to advise in ^he areas of 
standards, assessment, and implementation. The Science Task Force 
met at the Hotel Washington on October 15, 1991 from 10 a.m. to 5 
p.m. The purpose of the Science Task Force is to advise the Council 
on the desirability and feasibility of national standards in science, and 
give the Council direction, if national standards are found to be 
desirable and feasible. To focus the task, copies of the following were 
provided to the Task Force: Science FraTnework for California 
Public Schools (California State Board of Education); Science for All 
Americans, (American Association for the Advancement of Science); 
Earth Science, Content Guidelines, Grade K- 12, Earth 
Science Education for the 2 1st Century, a Planning Guide, 
(American Geological Institute); and 1994 NAEP Science Consensus 
Assessment Framework Project, (National Assessnient Governing 
Board). 
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Status of Efforts to Develop t^lational Standards in Science 

The Science Task Force agrees that there is currently no set of 
content and performance standards that can be used as national 
standards. However, the National Academy of Sciences is 
spearheading a unified effort of numerous science organizations to 
dev;elop national standards. In August, the National Academy 
submitted an unsolicited proposal to Secretary of Education Lamar 
Alexander and received initial funding to begin work on these 
standards. The National Academy has begun an analysis of current 
dociuments from the United States and other nations and is looking for 
common themes, content, and skills. By the end of 1991 the National 
Academy will have set up committees of science educators, teachers, 
administrators, state agencies, and the general public. Work on 
curriculum and learning outcomes v^ll begin first. Development of 
teaching and instruction standards, (which includes discussion of 
instructional materials, opportunity to learn, and professional 
•development) and assessment and performance standards will then 
occur simultaneously. 

Are National Standards Desirable, Given the Wide Range of 
Student Performance? 

Standards lend purpose to and reinforce the educational process. 
Standards can influence and improve science education and serve as 
the "glue*' that holds together the (education reform movement. 
Science teachers need to know what to teach. Nearly all elementary 
school teachers are responsible for science instruction, and they 
particularly need the framework that standards would give because 
they often have little or no background in science. Natioi;al standards 
would improve instructional materials by the emphasis and direction 
they would give to publishers and instructional material designers. 

Are Standards that Challenge All Children Without Penalizing 
Those of Lesser Opportunity Feasible? 

The disparities in opportunity are in fact a most compelling argument 
for the importance of standards. CJood standards used effectively can 
help reduce the disparities in opportunity. There must be good 
instructional models. Some districts need additional funding or a 
redistribution of funds so that cv(?ry child can be challenged and 
helped to do her or his best and meet the standards. Issues such as 
lack of proficiency in English need to be addressed separately. 

Who Should Develop the Stondords and How Should They be 
Developed? What t^tional, State, and Local Curriculum 
Materials Are the Best Available? 

The Task Force believes that the major groups repn^senting the 
science educational community are "getting together under the same 
tent" with the National Academy to deve?lop standards. This process 
will also need to involve others, including school boards, school 
administrators, parent groups, state education and policy groups, 
state boards, lay persons, and business leaders. Science experts may 
take the lead to develop proposals that are presented to lay review 
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groups. This dialogue should infoiro the public about the tough issues 
and, ultimately, about the decisions reached. 

Looking at the best international, national, state, and local 
curriculum materials is an important part of the National Academy's 
work to develop standards. There is much available. The American 
Association for the Advancement of Science (AAAS) in Scieyicejor 
AllAmencam reports on literacy goals in science, mathematics, and 
technology. Several professional societies have completed projects 
that provide good source material, such as the American Chemical 
Society which has guidelines on chemistry for K-12, and the 
publication of the American Geological Institute titled /i^ar/Zi Science, 
Content Guidelines, Grades K-lii, 

How Long Will it Take to Develop the Materials? What Can Be 
Done to Expedite the Process? 

By the fall of 1992, the National Academy of Sciences expects to have 
a draft of curriculum standards available for public scrutiny and 
debate. Consensus building will be the next step. Teachers must know 
and understand the process and recommendations. By 1994, the aim 
is to have content standards and soon thereafter assc^ssment 
standards and a prototype of assessment tasks. The first assessments 
may be possible by 1995. 

The National Assessment of p]ducational Progress (NAP]P) will 
assess science in 1994 at grades 4, 8, and 12 using a new assessment 
now being developed. The National Assessment Governing Board 
(NAGB) already has adopted a content framework for the science 
assessment based on a national consensus process. The framework 
spc^cifies the main topic:s to be tested, the relative weight for each, and 
the types of questions to be used. Later, after the assessment is 
constructed NAGB will set achievement levels for student 
performance. The NAF^P science assessment will be completed largely 
in 1992 and early 1993 and will be available^ to the National Academy 
committe(\s working on assessment standards. 

The main way to exp(^dite the standards development process is to 
expedite the funding. The initial funding for the development of 
science standards is available. Funding for the 1994 NAVjV sci(?nce 
assessment is appropriated, but funding for the National Academy 
standards development does not include assessment development. 
F]fforts also need to be underway to develop teacher support, public 
support, and school boardMistrict support. 

The Task Force did not discuss the funding implications for 
implenuuUing science standards across the nation. But a member 
noted that there are major costs involved in improving science 
education as this requires investment to de^velop "hand^-on" 
materials, new forms of assessment, massive in-service teacher 
education, and new prevservice science curricula. 

The **length of time to develop standards" does not addr(\ss directly 
the issue of the time required to implement curriculum standards. 
There is debate over how soon lew assessments of student 
performances can be used -~ that is liowsoon assessments can be 
used that are linked to new curriculum content standards that are 
being implemented. Several Task Force members suggested that 
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assessments should follow the successful implementation of 
curriculum standards. 

Other Issues 

Clarification is needed in the area of Earth Sciences. This field is also 
in the geography curriculum in the United States and other countries. 
Possibly the geography community should be included as the science 
community discusses this area. 

Technology is often linked with science, and there is continuing 
debate about the place of technology as a subject area in the science 
curriculum. Some contend that technology is a tool, albeit a powerful 
tool, for science, and others argue that the roles of science and 
technology are sometimes reversed. The Science Task Force certainly 
did not resolve this debate. In their brief discussion of technology, 
several Task Force members spoke of technology being built into the 
standards for teaching science rather than into the standards for 
science. 

The primary purpose of assessment must be to improve learning. 
Imbedded assessment, where the teacher assesses during the learning 
phase, should be part of the process. Assessment must convey what 
the student can do and what the student has trouble doing. 

Developing standards and assessments is a first step in determining 
what it takes to "get the standards to the student." We must give the 
teachers the support they need such as appropriate materials and 
staff development. School boards need to know what it takes to 
implement and meet standards. 

Students need to learn both factual knowledge about the world 
around them and the reasoning and skills involved in ''doing" science. 
This should not be viewed as an either/or question. As much as 
possible, students should gain the appropriate factual grounding iri a 
manner that also teaches them to reason and investigate scientifically. 
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Appendix K 



Report of the 
History Task Force 



Background 

The National Council on Education Standards and Testing was formed 
by Congress and the President. The Council created five Task Forces 
in the core disciplines of English, mathematics, science, history, and 
geography, plus three Task Forces to advise in the areas of standards, 
assessment, and implementation. The History Task Force met at the 
Hyatt Regency on October 23, 1991, from 10 a.m. to 5 p.m. The 
purpose of the History Task Force is to advise the Council in 
preparing its report. The Task Force was asked to respond to five 
specific questions relating to the desirability and feasibility of national 
standards in history, and to give the Council direction on the 
development of those standards, if national standards are found to be 
desirable and feasible. 

Status of Efforts to Develop Notional Standards in History 

The effort to develop national standards in history does not have to 
start from scratch but can build on previous work. There are a number 
of excellent documents already available: History-Social Science 
Framework (California State Board of Education) ] Building a 
History Curriculum: Guidelines for Teaching History iji the 
Schools (Bradley Commission); Charting a Course: Social Studies 



The views expressed in this appendix report rejlect the work of 
this Task Force and are not necessarily those of the Council 



January 24^ 



1992 



1 o n 



K-1 



for the 21st Century (Natioaal Commission on Social Studies in the 
Schools); Lessons from History: Essential Understandings and 
Historical Perspectives Students Should Acquire (National Center 
for History in the Schools). 

Also, the National Assessment of Educational Progress (NAEP) 
Consensus project in history will have content frameworks and test 
standards for testing on United States history in 1994 and world 
history in 1996. 

Are National Standards Desirable, Given the Wide Range of 
Student Performance? 

National standards would give guidance to teachers and to curriculum 
and textbook developers, and could help raise expectations in our 
schools if they are done the right way. 

National standards should be voluntary. They should not be overly 
specific, but should present a core of agreement on what is essential. 
They should be flexible, leaving room for local history, divergent 
curriculum frameworks, a variety of textbooks, and various ways of 
teaching. National standards sh jld have ci global dimension and 
include world as well as United States history. 

Are Standards ttuit Challenge Ail Children Without Penalizing 
Those of Lesser Opportunity Feasible? 

National standards can and must be fair, otherwise they will not 
survive the consensual development process nor be adopted by states 
and school districts. A test based on national standards will be fair 
because both educators ani young people will know exactly what they 
need to learn to be successful on the test. Moreover, national 
standards will help the cause of equity by focusing attention on the 
need for equal resources to meet equal standards. 

Studies show that children do not do well when their teachers have 
low expectations for them. All children have the right to aspire to the 
same set of goals, to be held to equally high expectations. National 
standards can thus be an instrument 'f equity by requiring all of us to 
do what it takes to educate all youngsters. 

Who Should Develop the Standards and How Should They Be 
Developed? 

National standards should be developed through a consensual process 
that allows various groups to be involved. The standard-setting 
process must be open and public. There must be several stages, so 
that the standards can be revised and refined in an iterative process, 
This process should involve teachers, professional organizations, 
groups with relevant expertise, and the public. There also needs to be 
some entity other than the federal government or any single 
professional association that brings all these groups together and 
coordinates the standard-setting process. 

High quality national standards will result in assessments that 
include essays and open-ended questions, not just multiple-choice 
items. 
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National standards should allow students to demonstrate different 
levels of proficiency or achievement. The standards should also 
encourage interpretation and analysis as part of the study of history, 
not just the learning of basic facts. 

History is an integrative field, since everything that has happened is 
part of history. National standards should be inclusive with regard to 
the content that can be taught in a historical framework, including 
civic education, economic history, art history, literature, geography, 
etc. 

How Long Will it Take to Develop the Materials? What Can Be 
Done to Expedite the Process? 

With appropriate resources, national standards could be developed 
within two years, perhaps sooner. It is vital to begin right away. 
Reading, writing, and mathematics assessment in NAEP are 
scheduled for 1993-94, and with geography and science moving 
forward as well, it is urgent to begin work immediately on history 
standards. 

At some point there may need to be an entity, perhaps a quasi- 
governmental agency, to give standards efforts legitimacy and to 
provide an imprin\atur for the standards developed by different, 
disciplines. Schools and teachers need to know that there will be a 
long-term national commitment to the new standards. 
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Report of the 
Geography Task Fbrce 



Background 

The National Council on F]ducation St andards and Testing was formed 
by the Congress and the President. The Council has created eight 
Task Forces to advise it on the best and most expeditious process to 
develop and implement standards in each subject area, Task Forces 
were created in the core areas of English, mathematics, science, 
history, and geography plus three others to advise in the areas of 
standards, assessment, and implementation. The Geography Task 
Force met on October 10, 1991, at the Hyatt Regency on Capitol Hill 
from 10 a.m. to 5 p.m. The purpose of the Geography Task Force is to 
advise the Council in preparing its report. The Task Force was asked 
to respond to five specific questions relating to the desirability and 
feasibility of national standards in geography and give the Council 
direction, if national standards are found to be desirable and feasible. 

Status of Efforts to Develop National Standards in Geography 

The Geography Task Force agreed that the work done by the National 
Council for Geographic Education (NCGE) and Association of 
American Geographers (AAG) called Guidelines for Geographic 
Education, which identified five fundamental themes in Geography 
and set up a sequence for geographic education, was an excellent 
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start toward the development of Content Standards in the field of 
Geography. 

Outgrowths of Guidelines for Geographic Education are two 
documents published by the Geographic Education National 
Implementation Project (GENIP). These documents, K-O Geography 
and 7-12 Geography provide themes, key ideas and learning 
opportunities, which are grade level specific. There was consensus 
that this body of work is the best currently in the field in the 
development of performance standards. However, much more work 
needs to be done. 

The Task Force agreed that the work being done by National 
Assessment of Educational Progress (NAEP) is the next major effort 
which will add to the development of content and performance 
standards in the field of Geography. NAEP will have initial work in 
Geography ready for publication in March or April of 1992. NAEP is 
using Guidelines for Geographic FJducation as one of its resources. 
NAEP and its governing board, NAGB, are working closely with the 
National Geographic Society as well as the major stake holders in the 
field of Geography. 

The Task Force agreed that other important work is being or has 
been done by NAGB, the National Geographic Society, the 
Department of Labor's Secretary's Committee on Acquiring Necessary 
Skills (vSCANS) Report, Careers in Geography, and the Geographic 
Alliance Network with AAG on tneir grant from the National Science 
Foundation. These efforts can be used in the development of 
geography standards. 

The Task Force agreed that an important contribution is being 
made by Geographic Alliance Network, which was started by National 
Geographic Society and provides direct assistance for geographic 
education on a state-by- state basis. The Geographic Alliance was 
formed in response to a growing sense of alarm that our geographic 
illiteracy was hampering our competitiveness in international trade. 
The task of the Alliance is to revitalize geography with appropriate 
groups and re-establish its presence and importance in the 
curriculum. The infrastructure of the Geographic Alliance Network 
will be useful in disseminating information to men^bers of the 
geographic community and to the public. 

Are National Standards Desirable, Given the Wide Range of 
Student Performance? 

The Task Force agreed that national standards are indeed desirable. 
The process of developing the National Standards will cause us as a 
Nation to identify what we believe to be important and permit the 
public and other stake holders to comment, scrutinize their efficacy, 
and help us as a Nation to identify and agree on national standards in 
geography. 

Are Standards ttiat Challenge All Children Without Penalizing 
Those of Lesser Opportunity Feasible? 

The Task Force agreed that the standards must be set without regard 
to sociological or demographic factors. It is a grotesque disservice to 
the country and to the child to assume a child by virtue of his or her 
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ethnic or socioeconomic background cannot achieve high standards. 
We assume eveiy child can learn and accomplish high standards, with 
sufficient time to learn, tools, a; d resources. The standards 
themselves do not impose any penalties. 

Who Should Be Involved in Developing Standards? Through 
What Process Should They Be Devebrad? Whot National, State, 
and Local Curriculum Materials Are the Best Available? 

The Task Force agreed that the widest possible variety of stake 
holders should be involved in the process of developing standards 
including teachers, specialists, content irea experts, pre-service 
teacher trainers, mass media, parents, business, legislators, textbook 
publishers, and possibly students. The question is the order in which 
they are to be involved, While there was some feeling that the 
"experts'* (e,g. professionals in geography) should present the initial 
effort to be critiqued by the other groups, there was also sentiment 
that all stake holders should be involved in the up-front process from 
the beginning. Clearly, however, the professional development of 
teachers regarding the new standards and learning strategies to 
support those standards is a critical feature that must be included in 
the over all plan. 

How Long Will it Take to Develop the Materials? What Can Be 
Done to Expedite the Process? 

The amount of time necessary to develop standards is at least one 
year (December 31, 1992). This time line was given under the 
assumption that appropriate funding and personnel could be assigned 
to the task. We feel that this is a very optimistic tmie line. 

Once the standards are released to the public and publishers, it 
probably takes 5 years to got a textbook series on the market. When 
the standards are in place there must be a concerted effort to get the 
information to the educational community and public, Appropriate 
learning strategies need to be identified and disseminated quickly. 

The task force did not identify the "best*' materials; instead, the task 
force acknowledged that the development of new materials which 
reflect the standards are another critical feature of the plan, 

Standard-Setting Exercise 

After an exercise in which the Task P'orce actually wrote some sample 
standards for the different grade levels, there was a general consensus 
that the use of the definitions of content, performance/ achievement 
standards was not completely clear. There needs to be more work and 
refinement on the definitions so that they are easily understandable. 
In fact, the use of "standards" following content, achievement, and 
performance (e.g. standards, standards, and standards) actually serve 
to confuse people who are reasonably expected to know something 
about their field. Many argued that the use of goals, objectives, and 
performance standards was clearer. 
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Further, it was difficult to set 8th grade standards, other than 
indicating that students should be expected to know more than 
they did in the 4th grade and less than the 1 2th grade. 
Other Areas of Consensus 

Debate occurred on whether geography was a separate or integrated 
discipline. There was consensus that the standards for the study of 
geography must be separated from the other disciplines. The result of 
imbedding it in other subjects is that only the understandings 
necessary for the other discipline are taught. It was believed that this 
has resulted in a lack of geographical understanding which has 
hampered the ability of our Nation to compete on the international 
market. 

In some areas, the representative from the Business Round Table 
emphasized different points. 

• The priority of business is not whether geography is taught as a 
separate entity, but that students understand practical concepts of 
geography that are useful knowledge to business. 

• Business should be involved in the process of developing the 
curriculum from the beginning. Business prefers not to have a 
blueprint given to it to proofread after it has been developed. 
Business has been on the "steering committees ' in the past; now it 
wants to be on the "working committees" with the content people 
and the teachers. Business wants the opportunity to react to (not 
set) standards at the time the standards are being considered. 

• The business community realizes the problem of developing 
standards, but it would like to see the process time cut in the effort 
to get an initial product out quickly for public scrutiny. 

The Task Force agreed that there is much that we can learn from the 
business community, and every effort must be made to incorporate 
them into the process. 
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